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SUMMARY 


A  growing  number  of  states  are  implementing  standards-based  school  accountability 
systems  in  an  effort  to  improve  student  achievement.  Washington  state’s  Education  Reform  Act 
is  an  example  of  such  a  reform.  It  mandated  the  creation  of  academic  standards,  called  the 
Essential  Academic  Learning  Requirements  (EALRs),  a  state  assessment  system,  called  the 
Washington  Assessment  of  Student  Learning  (WASL),  and  an  accountability  mechanism,  which 
is  still  under  development.  Washington  policymakers  have  adopted  a  gradual  approach  to 
implementation,  bringing  new  subjects  into  the  assessment  system  on  an  incremental  basis  over 
the  period  of  a  decade.  Researchers  from  RAND  and  the  University  of  Colorado,  Boulder,  are 
studying  the  implementation  and  impact  of  the  Washington  reform  on  school  and  classroom 
practices,  focusing  on  the  subjects  of  writing  and  mathematics. 

In  1998-99,  surveys  were  sent  to  a  representative  sample  of  about  150  elementary  and 
middle  school  principals  and  a  representative  sample  of  about  400  writing  and  mathematics 
teachers  in  fourth  and  seventh  grades.  These  are  the  grades  in  which  students  take  the  WASL 
tests.  The  surveys  asked  about  the  respondents’  familiarity  with  the  reform  and  their  opinions 
about  it.  Principals  were  also  asked  about  implementation  at  the  district  and  school  levels, 
including  changes  to  standards,  curriculum  and  assessments.  Teachers  were  also  asked  about 
their  participation  in  professional  development  and  changes  in  their  classroom  practices  in 
writing  and  mathematics. 

The  surveys  reveal  a  picture  of  schools  in  transition,  with  many  changes  occurring  but 
always  not  uniformly  across  teachers  or  schools.  Principals  and  teachers  in  Washington  have 
spent  a  great  deal  of  time  learning  about  the  reform,  and  they  believe  they  understand  its  key 
components  well.  In  general,  they  believe  the  standards  are  appropriate  and  attainable.  At  the 
district  level,  steps  are  being  taken  to  align  curriculum  and  assessment  with  the  state  system. 
Schools  and  teachers  are  also  working  to  make  their  programs  consistent  with  the  direction  set 
by  state.  Teachers  are  changing  classroom  curriculum  and  instruction  in  response  to  the  reform. 
In  general,  classroom  changes  appear  to  be  consistent  with  the  EALRs,  although  local  educators 
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appear  to  be  responding  most  to  the  highly-visible  WASL  scores  and  making  curriculum  changes 
primarily  in  the  WASL-tested  subjects.  Not  all  aspects  of  the  reform  are  equally  salient, 
however.  Classroom-based  assessment,  in  particular,  is  not  as  widely  understood  or  endorsed  as 
the  EALRs  and  WASL. 

There  are  also  a  few  differences  between  groups  that  are  worthy  of  attention.  Principals 
have  a  greater  understanding  of  the  reform  than  teachers,  and  they  are  more  positive  about  its 
basic  goals.  Teachers’  responses  vary  somewhat  across  subjects  and  grade  levels.  Mathematics 
teachers  have  made  more  recent  changes  to  classroom  practice  than  writing  teachers. 

Elementary  school  teachers  are  making  greater  changes  than  middle  school  teachers,  particularly 
in  the  subject  of  mathematics. 

Finally,  some  of  the  responses  raise  questions  about  the  whether  WASL  scores  and  score 
gains  represent  meaningful  indicators  of  attainment/mastery  of  the  standards.  Many  teachers 
think  that  the  WASL  is  not  appropriate  for  grade  levels  at  which  it  is  administered.  Most 
teachers  believe  that  test  preparation  is  responsible  for  most  score  gains.  These  issues  deserve 
further  scrutiny  as  the  accountability  system  is  implemented. 
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BACKGROUND  AND  PURPOSE 

In  1995,  researchers  at  RAND  and  the  University  of  Colorado,  Boulder  (CU  Boulder), 
began  a  program  of  research  on  the  impact  of  standards-based,  test-driven  reforms  on  school  and 
classroom  practices.  These  studies,  which  were  conducted  under  the  auspices  of  the  Center  for 
Research  on  Evaluation,  Standards,  and  Student  Testing  (CRESST),  included  both  statewide 
surveys  of  principals  and  teachers  and  case  studies  of  carefully  selected,  exemplary  teachers. 

The  research  design  called  for  conducting  similar  investigations  sequentially  in  two  states,  one 
that  was  an  “early  implementer”  of  standards-based  reform,  and  one  that  initiated  such  reforms  at 
a  later  time.  Kentucky  was  selected  as  the  first  state,  and  the  RAND  and  CU  Boulder  teams 
conducted  research  there  from  1995  to  1998.  Washington  was  selected  as  the  second  state,  and 
similar  research  began  there  in  1998.  This  report  presents  the  results  of  principal  and  teacher 
surveys  conducted  in  Washington  in  the  spring  of  1999.  Case  study  results  will  be  reported 
separately. 

Results  of  Prior  Research 

Research  in  Kentucky  indicates  that  standards-based  reforms  that  include  high  stakes 
testing  can  be  powerful  tools  to  change  what  is  happening  in  schools  and  classrooms  (Barron  and 
Stecher,  1999;  Borko  and  Elliott,  1998;  Borko  and  Elliott,  1999;  Stecher,  Barron,  Kaganoff  and 
Goodwin,  1998;  Stecher  and  Barron,  1999;  Mclver  and  Wolf,  1999;  Wolf  and  Mclver,  1999). 

On  the  positive  side,  the  Kentucky  education  reform,  which  included  new  standards  and 
performance  assessments  (KIRIS),  influenced  classroom  practices  in  both  elementary  and  middle 
schools.  The  developers  of  KIRIS  hoped  to  drive  instruction  in  particular  directions  by  basing 
the  assessment  on  open-response  questions  and  portfolios  rather  than  multiple-choice  questions. 
The  project  found  evidence  of  increased  professional  development  related  to  the  tests  and  the 
standards,  increased  coverage  of  the  subjects  tested  by  KIRIS,  and  increased  frequency  of 
standards-based  practices,  such  as  problem  solving  and  mathematical  communication. 

On  the  negative  side,  there  was  no  evidence  of  associations  between  changing  practices 
and  increased  KIRIS  scores.  In  addition,  teachers  appeared  to  focus  more  on  the  tests  than  on 
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the  standards  they  were  supposed  to  represent.  One  consequence  of  such  “teaching  to  the  test” 
was  that  curriculum  coverage  varied  significantly  from  one  grade  to  the  next  in  parallel  with  the 
subject  matter  emphasis  of  KIRIS.  For  example,  students  in  fourth  and  seventh  grades  received 
more  instruction  in  reading,  writing  and  science,  while  students  in  fourth  and  eighth  grade 
received  more  instruction  in  mathematics,  social  studies,  and  arts/humanities.  Furthermore,  the 
use  of  performance  assessments  that  more  fully  represented  the  domains  of  interest,  had  mixed 
effects  as  well.  For  example,  to  promote  writing  about  mathematics,  teachers  increased  the 
amount  of  time  students  spend  on  mathematics  at  the  expense  of  time  spent  on  other  subjects 
such  as  science.  Similar  shifts  in  emphasis  occurred  within  specific  subject  areas.  For  example, 
the  KIRIS  writing  test  focuses  on  short  written  pieces,  and  teachers  focused  on  that  type  of 
writing  at  the  expense  of  other  types  of  writing. 

The  case  studies  focused  on  a  dozen  teachers  whose  mathematics  and  writing  instruction 
was  deemed  by  others  to  be  exemplary  (Borko  and  Elliott,  1998;  Borko  and  Elliott,  1999;  Mclver 
and  Wolf,  1999;  Wolf  and  Mclver, 1999).  Observations  and  interviews  were  used  to  identify 
features  of  reform  that  supported  such  exceptional  practice,  e.g.,  an  extensive  network  of 
professional  development  opportunities  and  a  belief  at  the  school  level  of  the  importance  of 
ongoing  support  for  teacher  learning.  They  also  identified  elements  of  the  accountability  system 
that  frustrated  even  the  best  teachers.  For  example,  fourth  grade  teachers  reorganized  their 
mathematics  curriculum  against  their  better  judgment  in  order  to  produce  enough  pieces  to 
complete  students’  mathematics  portfolios. 

Current  Study 

In  1998  we  began  conducting  similar  investigations  in  Washington,  focusing  on  grades 
four  and  seven,  which  are  the  elementary  and  middle  school  grades  at  which  the  WASL  tests  are 
administered.  We  adapted  the  surveys  used  in  Kentucky  to  reflect  the  structure  of  the 
Washington  Education  reform.  In  some  cases  this  involved  merely  changing  terminology  and 
retaining  the  fundamental  framework  of  the  question.  In  many  cases  where  the  conditions  in  the 
two  states  were  substantially  different,  it  required  developing  whole  new  items.  Separate 
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surveys  for  principals  and  teachers  were  drafted,  field  tested  and  revised  during  the  fall  of  1998 
and  the  winter  of  1999.  The  final  surveys  were  administered  to  a  representative  sample  of 
elementary  and  middle  school  principals  and  teachers  in  grade  four  and  seven  in  the  spring  of 
1999.  Data  were  tabulated  and  analyzed  in  the  summer  and  fall,  and  the  results  are  presented 
here. 

In  1999-2000,  as  the  Washington  reform  is  more  fully  implemented,  we  will  conduct  a 
similar  set  of  surveys  focused  on  changes  in  practice.  We  will  also  compare  results  from  the  two 
states  to  see  if  differences  in  the  structure  of  the  programs  or  implementation  strategies  are 
associated  with  differences  in  their  impact  on  practice. 

Organization  of  the  Report 

The  remainder  of  the  report  is  organized  in  five  sections.  The  first  section  provides 
background  information  about  the  Washington  Education  Reform  for  readers  who  are  unfamiliar 
with  the  specific  ways  in  which  the  state  has  structured  its  standards,  assessments  and 
accountability  mechanism.  The  second  section  describes  our  research  methods.  The  third 
section  presents  results  from  principals,  focusing  on  administrative  changes.  The  next  section 
describes  the  results  from  teachers.  Teacher  responses  are  ordered  thematically  around  the  topics 
of  preparation  for  and  implementation  of  the  reform,  its  impact  on  instruction  and  assessment  in 
writing,  and  its  impact  on  instruction  and  assessment  in  mathematics.  Where  appropriate,  we 
separate  the  responses  from  fourth  grade  teachers  (who  were  responsible  for  both  writing  and 
mathematics  instruction),  seventh  grade  writing  teachers  and  seventh  grade  mathematics 
teachers.  The  final  section  is  a  discussion  of  the  implications  of  these  data  for  education  reform 
in  Washington  and  elsewhere. 
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WASHINGTON  EDUCATION  REFORM 

In  1992,  the  Washington  legislature  created  the  Commission  on  Student  Learning  (CSL), 
with  responsibility  for  developing  a  standards-based  accountability  system  for  the  state 
(SSB5953).  CSL  was  asked  to  develop  content  standards,  create  appropriate  assessments,  and 
devise  an  accountability  system  to  monitor  each  school’s  progress  in  achieving  the  standards. 
The  commission's  work  ultimately  led  to  the  Student  Learning  and  Improvement  Act  (ESHB 
1209),  which  the  legislature  passed  in  1993;  this  is  now  known  as  the  Education  Reform  Act. 
The  legislature  provided  $75  million  in  funding  to  support  the  Education  Reform  Act  during  its 
first  two  years,  the  largest  such  educational  expenditure  in  the  state’s  history  (CPRE  State 
Profile,  1996). 

The  intent  of  the  Education  Reform  Act  is: 

1.  Establishing  what  is  expected  of  students,  with  standards  set  at  internationally  competitive 
levels; 

2.  Parents  to  be  primary  partners  in  the  education  of  their  children,  and  to  play  a  significantly 
greater  role  in  local  school  decision  making; 

3.  Students  taking  more  responsibility  for  their  education; 

4.  Time  and  resources  for  educators  to  collaboratively  develop  and  implement  strategies  for 
improved  student  learning; 

5.  Making  instructional  programs  more  relevant  to  students'  future  plans; 

6.  All  parties  responsible  for  education  to  focus  more  on  what  is  best  for  students;  and 

7.  An  educational  environment  that  fosters  mutually  respectful  interactions  in  an  atmosphere  of 
collaboration  and  cooperation. 

Elements  of  the  Education  Reform 

Washington’s  education  reform  is  similar  to  standards-based  accountability  systems  in 
other  states  which  have  three  major  components:  a  set  of  standards,  measures  of  student 
performance,  and  a  system  of  incentives  for  improvement  (Education  Week,  1996). 

Washington’s  system  includes  statewide  standards  for  what  students  should  know  and  be  able  to 
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do,  called  the  Essential  Academic  Learning  Requirements  (EALRs),  tests  to  evaluate  student 
knowledge  and  progress  towards  standards,  called  the  Washington  Assessment  of  Student 
Learning  (WASL),  and  an  as-yet-to-be-developed  mechanism  to  hold  schools  accountable  for 
student  performance.  The  WASL  assessments  include  both  multiple-choice  and  open-response 
measures.  Another  distinguishing  feature  is  that  Washington  is  implementing  the  reform 
gradually  over  a  decade,  beginning  with  the  setting  of  standards,  proceeding  to  the  gradual 
introduction  of  assessments,  and  finally  the  development  of  an  accountability  system  that 
addresses  goals,  progress,  and  consequences  for  schools. 

Standards 

The  1993  legislation  established  four  basic  education  goals  for  students.  All  students 
shall:  1)  Read  with  comprehension,  write  with  skill,  and  communicate  effectively  and 
responsibly  in  a  variety  of  ways  and  settings;  2)  Know  and  apply  the  core  concepts  and 
principles  of  mathematics;  social,  physical  and  life  sciences;  civics  and  history;  geography;  arts; 
and  health  and  fitness;  3)  Think  analytically,  logically,  and  creatively,  and  integrate  experience 
and  knowledge  to  form  reasoned  judgements  and  solve  problems;  4)  Understand  the  importance 
of  work  and  how  performance,  effort,  and  decisions  affect  future  career  and  educational 
opportunities. 

Building  upon  these  basic  education  goals,  the  legislation  also  mandated  the  development 
of  more  specific  standards  for  academic  and  technical  skills  and  knowledge.  To  this  end,  the 
Commission  on  Student  Learning  (CSL)  established  EALRs  in  eight  content  areas:  reading, 
writing,  mathematics,  listening/communication,  science,  social  studies,  health/fitness,  and  the 
arts.  In  addition,  they  designated  three  benchmark  grades  at  which  performance  was  to  be 
assessed:  fourth  grade  (elementary),  seventh  grade  (middle  school)  and  tenth  grade  (high  school). 

The  EALRs  themselves  are  written  at  a  relatively  high  level  of  generality.  For  each 
subject  there  are  three  to  five  broad  performance  standards.  Table  1  contains  the  broad  standards 
for  writing  and  mathematics.  Each  standard  is  elaborated  by  descriptions  of  general  student 
behaviors  that  would  demonstrate  mastery  of  the  standard.  Table  2  illustrates  the  descriptions  of 
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student  behaviors  that  accompany  the  first  standards  in  writing  and  mathematics.  In  addition,  for 
each  behavior  there  are  more  detailed  benchmarks  describing  behaviors  that  would  be  expected 
for  students  in  grades  4,  7  and  10.  Examples  of  the  benchmarks  for  the  first  writing  and 
mathematics  standards  are  contained  in  the  Appendix. 


Table  1 

EALR  Standards  in  Writing  and  Mathematics 


_ _ Writing  _ 

1.  The  student  writes  clearly  and  effectively. 

2.  The  student  writes  in  a  variety  of  forms  for 
different  audiences  and  purposes. 

3.  The  students  understands  and  uses  steps  of 
the  writing  process. 

4.  The  student  analyzes  and  evaluates  the 
effectiveness  of  written  work 


_ Mathematics  _ 

1.  The  student  understands  and  applies  the 
concepts  and  procedures  of  mathematics. 

2.  The  student  uses  mathematics  to  define  and 
solve  problems. 

3.  The  student  uses  mathematical  reasoning. 

4.  The  student  communicates  knowledge  and 
understanding  in  both  everyday  and 
mathematical  language. 

5.  The  students  understands  how  mathematical 
ideas  connect  within  mathematics,  to  other 
subject  areas,  and  to  real-life  situations. 


Assessments 

Many  changes  were  made  in  the  state  assessment  system  as  part  of  the  education  reform. 
The  cornerstone  of  the  new  system  is  the  Washington  Assessment  of  Student  Learning  (WASL), 
which  was  developed  specifically  for  the  state  by  a  commercial  contractor.  The  test  includes 
several  different  types  of  items  designed  to  measure  student  performance  and  progress  towards 
the  standards.  In  the  areas  of  reading,  mathematics,  and  listening,  students  answer  multiple- 
choice,  short-answer,  and  extended  response  questions.  In  writing,  students  are  required  to  write 
essays  in  response  to  specific  prompts.  All  WASL  assessments  are  untimed,  and 
accommodations  are  made  for  students  with  special  needs. 

In  addition  to  the  WASL,  the  state  also  administers  norm-referenced  standardized  tests  at 
selected  grade  levels.  The  state  recently  changed  standardized  tests,  adopting  the  Iowa  Tests  of 
Basic  Skills  (ITBS),  and  the  Iowa  Tests  of  Educational  Development  (ITED).  At  the  time  of  this 
survey,  these  tests  were  administered  in  grades  3  and  8  in  the  subjects  of  reading  and 
mathematics,  and  in  grade  1 1  in  the  subjects  of  reading,  language  arts  and  mathematics.  Most 
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school  districts  also  select  and  administer  exams  beyond  those  provided  by  the  state. 


Table  2 

EALR  Details  in  Writing  and  Mathematics 


The  student  understands  and  applies  the 

The  student  writes  clearly  and  effectively _ concepts  and  procedures  of  mathematics 

To  meet  this  standard,  the  student  will:  To  meet  this  standard  the  student  will: 


1.1  develop  concept  and  design  (develop  a 
topic  or  theme;  organize  written  thoughts 
with  a  clear  beginning,  middle  and  end;  use 
transitional  sentences  and  phrases  to 
connect  related  ideas;  write  coherently  and 
effectively) 

1.2  use  style  appropriate  to  the  audience  and 
purpose  (use  voice,  word  choice,  and 
sentence  fluency  for  intended  style  and 
audience) 

1.3  apply  writing  conventions  (know  and  apply 
correct  spelling,  grammar,  sentence 
structure,  punctuation,  and  capitalization) 


1 . 1  understand  and  apply  concepts  and 

procedures  from  number  sense  (number  and 
numeration,  computation,  and  estimation) 


1 .2  understand  and  apply  concepts  and 
procedures  from  measurement  (attributes 
and  dimensions,  approximation  and 
precision,  and  systems  and  tools) 

1.3  understand  and  apply  concepts  and 
procedures  from  geometric  sense  (shape  and 
dimension,  and  relationships  and 
transformations) 

1 .4  understand  and  apply  concepts  and 
procedures  from  probability  and  statistics 
(probability,  statistics,  and  prediction  and 
inference) 

1 .5  understand  and  apply  concepts  and 

procedures  from  algebraic  sense  (relations 
and  representations,  and  operations) _ 


Another  element  of  the  overall  assessment  system  is  classroom-based  assessments  (CBA) 
related  to  the  WASL.  The  state  has  developed  materials  and  provided  some  funds  to  schools  to 
support  improved  classroom  assessments.  Emphasis  has  been  given  to  performance-based 
measures,  which  may  include  examples  of  student  work,  such  as  experiments  or  projects,  or 
information  provided  through  oral  interviews  or  presentations.  The  goal  of  classroom-based 
assessments  is  to  help  teachers  respond  to  individual  students’  strengths  and  weaknesses,  some 
of  which  may  be  difficult  to  assess  with  the  WASL.  The  state  believes  that  CBA  is  an  essential 
component  of  a  good  instruction  program  because  such  assessments  “can  be  tailored  to  the 
varying  developmental  needs  and  learning  styles  of  students.  Classroom-based  assessments, 
along  with  regular  exams,  quizzes  and  projects,  are  intended  to  ensure  that  learning  continues 
throughout  the  school  year.”  (OSPI,  2000) 
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The  state  also  promoted  improved  classroom-based  assessments  through  the  development 
and  distribution  of  assessment  Tool  Kits  and  a  piece  of  software  called  NCS  Mentor®.  The  Tool 
Kits  are  intended  to  provide  teachers  with  strategies  to  assess  student  performance  that  are 
aligned  with  the  standards.  The  Tool  Kits  include  checklists  of  skills,  observation  assessment 
strategies,  models  of  written  tasks,  rating  scales  for  student  work,  and  generic  protocols  for 
conducting  personal  interviews  and  other  forms  of  oral  communication  (Commission  on  Student 
Learning,  1999).  The  Tool  Kits  also  include  content  frameworks  to  help  teachers  align  their 
classroom  activities  and  instruction  to  the  EARLs.  NCS  Mentor®  offers  teachers  interactive 
help  in  aligning  their  own  tests  with  the  EALRs. 

Washington  has  implemented  their  education  reforms  gradually  over  a  period  of  many 
years  (unlike  many  states — including  Texas,  Kentucky,  and  North  Carolina — which 
implemented  standards-based  reforms  rapidly).  For  example,  the  EARLs  for  reading,  writing, 
mathematics,  and  listening  were  developed  first  in  1995.  The  EARLs  for  science,  social  studies, 
health/fitness  and  the  arts  followed  in  1996.  The  implementation  of  the  WASL  has  been  even 
more  gradual.  The  fourth  grade  WASL  in  reading,  writing,  mathematics  and  listening  was 
offered  for  the  first  time  on  a  voluntary  basis  in  1996-97,  and  it  became  mandatory  the  following 
year.  For  seventh  grade  students,  the  assessments  were  voluntary  in  1997-98,  and  will  be 
mandatory  in  the  2000-01  school  year.  The  complete  assessment  system  will  be  fully 
implemented  by  2008  (see  Table  3). 

Following  the  first  voluntary  administration  of  the  WASL,  a  standard-setting  committee 
met  to  decide  what  level  of  performance  would  constitutes  accomplishment  of  the  standards  in 
the  areas  of  reading  and  mathematics  in  the  tested  grades.  They  designated  four  levels  of 
performance  for  students,  two  levels  representing  performance  that  met  or  exceeded  the  standard 
(designated  Level  3  and  Level  4,  respectively)  and  two  levels  representing  performance  below 
the  standard  (Levels  1  and  2).  Four  levels  are  used  to  make  the  assessment  more  sensitive  to 
changes  in  student  performance  over  time  and  to  provide  an  indication  of  the  distance  between  a 
student  s  performance  and  the  standard.  However,  for  most  public  reporting  purposes,  results  for 
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schools  are  presented  in  terms  of  the  percent  of  students  who  meet  or  exceed  the  standard.  The 
results  for  the  listening  and  writing  assessments  indicate  only  whether  the  student  meets  the 
standard  or  does  not. 


Table  3 

Washington  Assessment  of  Student  Learning  (WASL)  Implementation  Timeline 


Subject 

School  level 

Available  for 
voluntary  use 

Required 

Reading,  writing. 

Elementary 

1996-97 

1997-98 

listening,  mathematics 

Middle 

1997-98 

2000-01 

High 

1998-99 

2000-01 

Science 

Elementary 

2001-02 

2004-05 

Middle  &  High 

1999-00 

2000-01 

Social  studies 

Elementary, 

Middle  &  High 

2002-03 

2005-06 

Arts 

Elementary 

2003-04 

2007-08 

Middle  &  High 

2003-04 

2006-07 

Health  and  fitness 

Elementary 

2003-04 

2007-08 

Middle  &  High 

2003-04 

2006-07 

Accountability 

The  third  component  of  Washington’s  Education  Reform  System  is  school  and  district 
accountability.  The  stated  purpose  of  the  accountability  system  is  to  improve  student  learning 
and  the  achievement  of  the  standards  by  providing  a  structure  of  incentives  and  assistance  for 
schools  and  districts.  Like  many  other  states,  Washington’s  reforms  focus  on  schools  and 
districts  — rather  than  teachers  or  students— as  the  units  of  performance  and  accountability.  The 
body  responsible  for  oversight  and  the  development  of  accountability  policies  is  now  the 
Academic  Achievement  and  Accountability  Commission  (referred  to  as  the  A+  Commission). 
The  Commission  has  specific  responsibilities,  including  adopting  and  revising  performance 
improvement  goals;  setting  standards;  adopting  criteria  to  identify  successful  schools  and  those 
in  need  of  assistance;  identifying  performance  incentive  systems;  annually  reviewing  the 
assessment  system,  and  recommending,  by  September  2000,  accountability  policies,  including 
state  intervention  strategies  for  low-performing  schools. 

The  Commission  is  likely  to  recommend  an  incremental  approach  on  the  part  of  the  state 
towards  intervention  in  low-performing  schools.  The  initial  responsibility  to  help  schools  will 
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probably  reside  with  districts,  but  if  the  district  action  fails  to  improve  performance  in  a  school, 
the  state  will  intervene.  However,  it  is  not  yet  clear  what  the  extent  of  this  intervention  will  be. 

Professional  Development 

The  final  component  of  the  state’s  educational  reform  is  professional  development  for 
teachers.  Sixteen  “Regional  Learning  and  Assessment  Centers”  were  established  across  the  state 
to  provide  assistance  to  local  schools  and  districts.  The  Centers  offer  a  range  of  professional 
development  opportunities  on  a  fee  basis,  including  training  related  to  the  state  standards, 
curriculum  alignment,  and  the  new  statewide  assessments.  The  state  also  encouraged  districts 
and  schools  to  send  study  teams  to  receive  training  in  classroom-based  assessment  strategies 
developed  by  Richard  Stiggins  (1996).  In  the  second  year  of  the  reform,  the  state  distributed 
10,000  copies  of  the  Stiggins  book  to  participating  schools  and  districts. 

The  Education  Reform  Act  also  allocated  additional  resources  in  the  form  of  Student 
Learning  Improvement  Grants  (SLIG)  that  districts  use  for  professional  development.  Districts 
that  applied  received  a  per  pupil  allocation  of  funds  for  professional  development  in  the  1997-98 
school  year.  In  1998-99,  the  program  was  modified  to  provide  “Learning  Improvement 
Allocations”  to  all  school  districts  to  "enhance  the  ability  of  instructional  staff  to  teach  and  assess 
the  EALRs  for  reading,  writing,  communication  and  math...(with)  special  emphasis...  given  to 
successful  teaching  of  reading"  (Bergeson,  Yoshitomi,  and  Butts,  1998).  In  1999-2000  the 
monetary  awards  were  made  contingent  upon  districts  adding  three  professional  development 

days  to  the  school  calendar  to  focus  on  improving  student  learning  consistent  with  the  education 
reform. 

WASL  Results 

Initial  results  from  WASL  showed  that  only  a  minority  of  students  were  achieving  the 
more  rigorous  standards  embodied  in  the  state  reforms.  Fewer  than  one-quarter  of  the  students 
met  the  standards  in  mathematics  in  the  first  year  that  WASL  was  administered.  Fewer  than  one- 
half  met  the  standards  in  reading  or  writing.  The  most  recent  WASL  results  are  more 
encouraging,  showing  gains  in  the  percentage  of  students  meeting  the  standards  in  mathematics. 
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reading  and  listening  in  elementary  and  middle  schools  (see  Table  4).  Of  course,  there  is  still 
much  room  for  improvement.  Approximately  one-third  of  fourth  graders  and  more  than  half  of 
seventh  graders  tested  at  Level  1  this  year.  Writing  performance  has  been  mixed.  Fourth  grade 
writing  scores  have  dropped  for  the  second  consecutive  year,  but  there  was  improvement  among 
seventh  graders. 

Table  4 

Statewide  WASL  Results 


Percent  of  students 
meeting  standard 

1997 

Fourth  grade 
1998 

1999 

1997 

Seventh  grade 
1998 

1999 

Mathematics 

21 

31 

37 

* 

20 

24 

Reading 

48 

56 

59 

* 

38 

41 

Writing 

43 

37 

33 

* 

31 

37 

Listening 

62 

71 

71 

* 

80 

87 

Other  Elements  of  Education  Reform 

Other  components  have  been  added  to  the  reform  during  the  past  couple  of  years 
(Bergeson,  Yoshitomi,  and  Butts,  1999).  These  include  annual  a  second  grade  reading 
assessment,  reading  improvement  goals  for  fourth  grade,  and  supplemental  reading  teachers  for 
low  performing  schools.  In  1998  the  state  adopted  a  second  grade  reading  assessment  to  provide 
an  early  identification  of  students  with  potential  reading  problems.  Districts  must  select  a  test 
from  those  approved  by  the  state  and  administer  it  individually  to  all  second-grade  students.  The 
purpose  of  the  test  is  to  identify  students  who  are  “substantially  below  grade  level”  so  they  can 
receive  supplemental  reading  instruction. 

The  legislature  also  passed  new  regulations  requiring  all  districts  to  establish  fourth  grade 
reading  goals  on  WASL  to  be  achieved  by  the  end  of  the  2000-01  school  year.  Each  district 
must  choose  either  1996-97  or  1997-98  as  a  baseline  against  which  to  measure  progress.  They 
must  establish  a  reading  improvement  goal  that  would  result  in  25%  fewer  fourth  grade  students 
failing  to  meet  the  standard  in  the  2000-01  school  year.  For  example,  if  60%  of  students  failed  to 
meet  the  standard  in  the  baseline  year,  the  goal  for  2001  would  be  a  drop  of  at  least  25%  in  this 
percentage  i.e.,  no  more  than  45%  failing  to  meet  the  reading  standard.  Districts  must  establish 
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similar  goals  for  mathematics  in  fourth  grade  and  seventh  grade  by  2001;  these  goals  must  be 
met  by  the  end  of  the  2003-04  school  year. 

The  newest  element  of  the  reform  is  the  Washington  Reading  Corps.  This  program 
provides  grants  to  districts  to  implement  “proven  research-based  mentoring  and  tutoring 
programs”  in  reading  for  low  performing  students  (Bergeson,  Yoshitomi,  and  Butts,  1999;  p  43). 

Such  programs  can  take  place  before,  during  or  after  school,  on  weekends  or  during  vacation 
times. 


12 


METHODOLOGY 


In  the  spring  of  1999,  we  surveyed  a  representative  sample  of  about  150  principals  and 
about  400  teachers  from  across  the  state  of  Washington.  Surveys  were  sent  to  elementary  and 
middle  school  principals  as  well  as  the  teachers  in  the  WASL-tested  grades  (fourth  and  seventh 
grade)  at  the  same  schools.  This  report  summarizes  the  results  of  the  survey  component  of  the 
project.  Case  studies  of  exemplary  teachers  in  these  grades  and  subjects  were  also  conducted, 
and  companion  reports  will  describe  the  case  study  findings. 

Sampling 

Schools  in  Washington  were  stratified  based  on  the  type  of  community  in  which  the 
school  was  located,  and  a  stratified  random  sample  of  schools  (based  on  proportional 
representation  of  the  strata)  was  selected.  The  three  strata  were  urban,  urban  fringe/large  town, 
and  small  town/rural.  Schools  with  fewer  than  20  students  in  the  tested  grade  were  excluded 
from  the  sampling  frame,  as  were  schools  with  recent  changes  in  their  service  areas.  Middle 
schools  were  limited  to  schools  that  administered  WASL  on  a  voluntary  basis.  For  each  of  the 
survey  populations  (elementary  schools  and  middle  schools),  70  schools  were  selected.  No 
school  was  chosen  for  more  than  one  sample. 

A  letter  was  sent  to  the  principal  of  each  school  at  the  beginning  of  1999  explaining  the 
study  and  requesting  the  names  of  the  instructors  teaching  the  identified  grade  (and,  in  middle 
schools,  the  identified  subject).  Principals  were  subsequently  contacted  by  telephone  to  retrieve 
these  names.  Ninety-four  percent  of  the  principals  in  the  sampled  schools  provided  the  requested 
information.  In  small  schools,  all  teachers  in  the  target  grade  levels  (fourth  and  seventh  grades) 
were  included  in  the  study.  In  large  schools,  it  was  necessary  to  sample  teachers  in  order  to  use 
the  available  resources  to  collect  data  from  a  sizeable  number  of  schools.  In  elementary  schools 
with  more  than  three  teachers,  a  random  sample  of  three  teachers  was  selected.  In  middle 
schools  with  more  than  two  math  or  writing  teachers,  random  samples  of  up  to  two  writing 
teachers  and  up  to  two  math  teachers  were  selected. 
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Principals  and  teachers  were  then  contacted  by  mail.  The  contact  letter  explained  the 
study  and  asked  for  their  participation.  Enclosed  with  the  request  was  a  letter  from  the  Office  of 
the  Superintendent  of  Public  Instruction  urging  respondents  to  cooperate,  a  copy  of  the  survey  to 
be  completed,  a  return  envelope,  and  a  ten  dollar  gift  certificate  for  purchasing  books  or  other 
instructional  materials.  Principals  and  teachers  could  keep  the  gift  certificate  regardless  of 
whether  they  returned  the  survey. 

A  total  of  108  principals  (77%)  and  277  teachers  (69%)  returned  completed  surveys. 

Table  5  contains  the  survey  completion  rates  for  each  of  the  four  samples.  The  median  tenure  for 
principals  was  ten  years  at  their  current  school.  On  average,  the  teachers  who  completed  surveys 
had  about  a  dozen  years  of  experience.  The  median  tenure  for  fourth  grade  teachers  was  17 
years  and  for  seventh  grade  teachers  it  was  nine  years.  Both  groups  of  teachers  had  acquired 

one-half  of  their  teaching  experience  at  their  current  school.  About  one-half  of  the  teachers  had 
master’s  degrees. 


There  were  very  few  cases  in  which  teachers  taught  writing  exclusively.  All  fourth  grade 
writing  teachers  are  responsible  for  multiple  subjects:  reading,  writing,  mathematics, 
communication,  social  studies,  and  science.  Many  fourth  grade  teachers  alto  teach  arts,  health, 
and/or  other  subjects.  At  the  seventh  grade  level,  almost  all  writing  teachers  also  taught  reading 
and  communication;  only  9%  of  teachers  who  identified  themselves  as  writing  teachers  did  not 
teach  reading.  While  most  writing  teachers  were  also  reading  teachers,  70%  of  writing  teachers 
also  taught  social  studies,  mathematics,  science,  and/or  arts. 

Table  5 

Survey  Samples  and  Response  Rates 


Respondent 

Principals 

Teachers 


Elementary  school  /grade  4} 
Sample  size  Response  rate 


70 

179 


75.7% 

74.9% 


Middle  school  ( grade  7} 
Sample  size  Response  rate 

70  78.6% 

221 _  64.7% 


Similarly,  the  mathematics  teachers  were  multi-disciplinary.  All  fourth  grade 
mathematics  teachers  also  teach  reading,  writing,  social  studies  and  science.  One-half  of  the 
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seventh  grade  mathematics  teachers  also  teach  other  subjects.  Eight  percent  teach  reading  and 
mathematics  exclusively  while  41%  teach  mathematics  in  addition  to  reading,  social  studies, 
science,  arts,  and/or  health. 

Survey  Development 

The  teacher  surveys  were  similar  to  surveys  the  project  fielded  in  Kentucky  the  previous 
school  year,  however  they  were  modified  to  reflect  the  Washington  reform  language  and 
priorities.  The  teacher  surveys  collected  information  about  teachers’  familiarity  with  and 
opinions  about  the  state  reforms,  as  well  as  information  about  teachers’  participation  in 
professional  development  and  their  classroom  practices.  Specifically,  the  survey  asked  teachers 
about  their  allocation  of  time  to  subjects,  teaching  strategies,  and  topics  within  writing  and 
mathematics  instruction.  Additionally,  teachers  reported  recent  changes  in  their  instruction  and 
influences  on  instructional  changes,  including  state  reforms. 

Questions  about  the  content  of  the  writing  and  mathematics  curriculum  were  based  in 
part  on  the  EALRs.  The  EALRs  in  writing  specify  four  broad  areas  of  writing  proficiency. 
Students  should  write  clearly  and  effectively,  write  in  a  variety  of  forms  for  different  audiences 
and  purposes,  understand  and  use  the  steps  of  the  writing  process,  and  be  able  to  analyze  and 
evaluate  the  effectiveness  of  written  work  (Washington  State  Commission  on  Student  Writing, 
1997).  These  four  areas  are  subdivided  into  fourteen  behaviors,  ranging  from  “develop  concept 
and  design”  to  “seek  and  offer  feedback.”  Each  of  these  behaviors  is  further  described  in  terms 
of  specific  performances  that  serve  as  benchmarks  forjudging  mastery  at  each  of  the  tested  grade 
levels.  The  survey  asked  teachers  about  their  emphasis  on  the  fourteen  writing  behaviors 
described  in  the  EALRs,  as  well  as  teaching  strategies  and  the  types  of  written  assignments  given 
by  writing  teachers. 

In  mathematics  the  EALRs  specify  five  broad  areas  of  proficiency.  Students  should  be 
able  to  understand  and  apply  the  concepts  and  procedures  of  mathematics,  use  mathematics  to 
define  and  solve  problems,  use  mathematical  reasoning,  communicate  knowledge  and 
understanding  both  in  everyday  and  mathematical  language,  and  understand  how  mathematical 
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ideas  connect  within  mathematics,  to  other  subject  areas  and  to  real-life  situations.  The  first  area 
of  proficiency  emphasizes  mathematics  content  and  curriculum:  number  sense,  measurement, 
geometric  sense,  probability  and  statistics,  and  algebraic  sense.  The  rest  of  the  proficiencies 
focus  on  mathematical  processes,  such  as  “investigate  situations,”  “analyze  information,”  and 
“represent  and  share  information.”  Student  behaviors  that  illustrate  the  achievement  of  each 
EALR  at  each  tested  grade  level  are  described;  these  behaviors  are  benchmarks  forjudging 
mastery  of  each  EALR  at  grades  4,  7  and  10.  We  asked  teachers  about  the  frequency  with  which 
a  variety  of  specific  areas  of  content  and  specific  instructional  activities  are  covered  in  their 
classrooms.  We  also  asked  teachers  how  the  frequency  of  their  coverage  of  these  areas  of 
content  and  instructional  activities  have  changed  over  the  past  two  years. 

Principals  provided  information  about  education  reform  at  both  the  district  and  school 
levels.  At  the  district  level,  they  responded  to  questions  about  curriculum,  standards, 
assessments,  and  accountability.  At  the  school  level,  they  responded  to  questions  about 
implementation  (e.g.,  how  the  respondent  learned  about  the  reform,  whether  they  endorse  it’s 
principles,  etc.),  impact  (e.g.,  changes  made  as  a  result  of  the  reform,  factors  that  were  most 
influential,  etc.),  and  testing  (e.g.,  test  preparation  practices). 

Most  of  the  items  on  both  surveys  focused  on  behaviors,  but  we  also  asked  for  teachers’ 
and  principals’  opinions  about  a  number  of  issues,  including  the  Washington  assessments  and 
their  impact  on  schools,  classroom  practices,  and  student  learning.  The  surveys  also  contained 
questions  related  to  respondent  background  and  professional  development.  Most  of  the  survey 
questions  were  presented  in  a  closed  format.  Respondents  were  asked  to  provide  numerical 
answers  or  to  select  one  option  from  a  predetermined  set  of  options  (e.g.,  three-,  four-,  and  five- 
point  Likert  scales,  and  yes/no  questions).  Some  questions  were  open-ended  permitting 
principals  and  teachers  to  write  in  their  own  responses.  For  most  questions  about  practice, 
respondents  were  asked  about  current  behaviors  (during  the  1998-99  school  year)  and  about 
changes  during  the  past  two-year  period.  Only  respondents  who  had  at  least  two  years  of 
experience  in  their  present  position  answered  questions  about  changes  in  practice. 


Data  Analysis 

For  most  questions  on  the  principal  survey,  we  computed  frequency  distributions  of 
responses  at  each  point  on  the  response  scale.  For  questions  requiring  a  numeric  response, 
means  and  standard  deviations  were  calculated.  Analysis  of  the  open-response  questions 
required  coding  and  tabulation  of  the  various  principal  and  teacher  responses. 

Because  we  sampled  teachers  in  the  larger  schools  (rather  than  surveying  all  teachers), 
we  had  to  weight  teachers  responses  to  obtain  results  that  reflected  all  teachers  in  Washington 
(fourth  grade  teachers,  seventh  grade  writing  teachers,  and  seventh  grade  mathematics  teachers). 
The  weights  insured  that  teachers  in  large  and  small  schools  were  given  the  proper  influence  in 
the  descriptive  statistics.  The  weight  assigned  to  each  teacher  was  the  product  of  the  inverses  of 
the  probability  that  the  school  would  be  selected,  the  probability  the  teacher  would  be  selected, 
and  probability  that  the  sampled  individuals  would  participate  (complete  the  survey). 

The  purpose  of  the  surveys  was  to  obtain  early  indications  of  teacher  and  principal 
opinion  about  the  Washington  education  reform,  and  to  judge  its  initial  impact  on  practice.  For 
this  reason,  the  surveys  were  broad  in  nature  and  many  questions  were  asked.  The  data 
collection  was  designed  to  provide  a  large  amount  of  information  from  a  number  of  groups  rather 
than  to  maximize  our  power  for  making  specific  comparisons  between  groups.  Thus,  we  do  not 
focus  much  attention  on  testing  the  significance  of  differences  between  specific  groups  of 
principals  or  teachers.  Given  the  design  of  the  study  and  the  large  numbers  of  comparisons 
being  made,  most  standard  statistical  tests  properly  applied  would  fail  to  detect  many  real 
differences.  Instead  we  focus  on  differences  which  seem  large  enough  to  be  of  practical 
importance.  The  downside  of  this  approach  is  that  it  is  almost  certain  that  there  will  be  a  small 
number  of  comparisons  that  we  highlight  that  are  in  fact  due  to  chance.  However,  given  the 
nature  of  the  study  this  weakness  was  preferred  to  the  option  of  missing  many  important 
comparisons  due  to  a  stringent  significance  threshold. 

As  is  the  case  with  all  survey  research,  several  factors  may  threaten  the  validity  of  the 
conclusions  reached  in  this  study.  There  may  be  selection  effects  because  not  all  principals 
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provided  us  with  teachers’  names,  and  not  all  principals  or  teachers  chose  to  participate. 
Although  the  response  rates  were  reasonably  high,  these  refusals  may  have  introduced  some 
degree  of  bias  into  the  reported  results.  One  must  also  be  cautious  about  self-reported  data. 
Respondents  may  have  answered  in  ways  they  considered  socially  desirable,  leading  to  results 
that  do  not  reflect  teachers’  true  beliefs. 


To  avoid  overly  complex  language  we  will  often  omit  explicit  reference  to  the  self- 
reported  nature  of  the  results.  ‘One-half  of  the  teachers  have  Masters’  degrees’  is  far  easier  to 
read  than  ‘one-half  of  the  fourth-grade  teachers  in  our  sample  reported  that  they  have  Masters’ 
degrees.’  The  reader  should  remember  that  all  these  results  are  based  on  principal  and  teacher 
survey  responses.  In  addition,  we  occasionally  refer  to  the  results  for  seventh-grade  teachers 
instead  of  ‘seventh-grade  teachers  who  teach  writing  or  mathematics.’  The  reader  should  keep  in 
mind  that  we  surveyed  only  writing  and  mathematics  teachers  at  the  seventh  grade. 
Generalizability  of  Findings 


The  sample  was  drawn  to  maximize  the  chances  of  obtaining  representative  groups  of 
Washington  elementary  school  principals,  middle  school  principals,  fourth-grade  teachers, 
seventh-grade  writing  teachers  and  seventh-grade  mathematics  teachers.  To  test  the  validity  of 
the  sampling  process,  we  compared  key  features  of  schools  with  completed  principal  surveys 
with  schools  in  the  state  as  a  whole  on  four  variables:  school  enrollment  in  the  tested  grade, 
percent  minority  in  the  school,  WASL  mathematics  scores  and  WASL  writing  scores.  The 
school-level  means  were  similar  to  the  population  means  for  elementary  schools  and  middle 
schools  on  these  variables  (see  Table  6). 


Table  6 

Comparison  of  State  and  Sample 

(mean  values) 


Elementary  school  ( grade  41 
Feature _ State _ Sample 


Percent  minority 

24.7 

24.3 

Grade  enrollment 

70.9 

76.7 

WASL  math* 

30.6 

30.6 

WASL  writing* 

35.8 

34.2 

Note:  *  Percent  meeting  standard 


Middle  school  Orade  7^ 

State 

Sample 

21.4 

21.8 

171.3 

161.4 

18.9 

16.8 

30.1 

28.7 
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RESULTS:  ELEMENTARY  AND  MIDDLE  SCHOOL  PRINCIPALS 

Almost  all  principals  believe  they  have  a  good  understanding  of  the  Washington 
education  reform,  and  they  endorse  its  central  goals  for  students.  Much  of  the  professional 
development  they  participated  in  addressed  the  EALRs,  WASL  and  classroom-based 
assessments.  Only  a  small  percentage  of  the  principals  were  directly  involved  in  state 
committees  helping  to  develop  or  implement  the  reform,  but  most  principals  participated  on 
district  or  school  committees,  particularly  committees  working  to  align  curriculum  with  the 
EALRs. 

Most  districts  added  or  modified  their  standards  and  assessments  to  bring  them  in  line 
with  the  EALRs,  and  most  principals  think  the  alignment  between  local  policies  and  the  EALRs 
is  good,  particularly  in  the  WASL-tested  subjects.  One  consequence  of  the  reform  is  that  the 
amount  of  testing  is  rising  in  both  elementary  and  middle  schools.  In  addition  to  the  state 
mandated  tests,  district  are  increasing  local  testing,  using  both  commercial  tests  and  locally 
developed  tests. 

The  vast  majority  of  principals  reported  that  the  Washington  education  reform  promoted 
better  instruction  and  increased  student  learning,  and  they  indicated  that  the  EALRs  and  WASL 
were  the  most  influential  elements  of  the  reform.  Principals  felt  widespread  pressure  for  students 
to  do  well  on  all  outcome  indicators,  but  they  felt  the  greatest  pressure  for  students  to  perform 
well  on  the  state  assessments  (WASL  and  the  state  norm-referenced  test).  The  greatest  perceived 
pressure  to  perform  well  comes  from  district  administrators,  the  media  and  OSPI. 

According  to  principals,  education  reform  has  led  to  valuable  professional  development 
opportunities  for  teachers,  and  school-initiated  professional  development  focused  more  on 
curriculum  alignment,  the  EALRs,  and  WASL  than  on  classroom-based  assessment  or  district 
tests.  Schools  have  taken  a  number  of  actions  specifically  designed  to  improve  WASL  scores, 
including  providing  professional  development,  sharing  information  about  WASL,  trying  to 
motivate  teachers  and  students,  changing  school  schedules,  and  improving  curriculum  and 
instruction.  Most  principals  believe  that  test  preparation  activities  have  accounted  for  past 
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WASL  score  gains,  although  they  also  believe  that  better  classroom-based  assessment  will  lead 
to  gains  in  the  future. 

Principals’  Understanding  of  Educational  Reform 

Almost  all  principals  report  that  they  understand  the  central  elements  of  the  educational 
reform  well  or  very  well.  Table  7  shows  that  over  80%  of  principals  are  comfortable  with  their 
knowledge  of  the  EALRs,  WASL  and  the  alignment  of  curriculum  and  instruction.  Almost  as 
many  are  confident  in  their  knowledge  of  classroom-based  assessment. 


Table  7 

Principals’  Understanding  of  Education  Reform 

(percent  of  principals  who  understand  well  or  very  well) 


Aspect  of  reform 

Elementary 

school 

Middle 

school 

Washington  student  assessment  (WASL) 

90 

92 

Essential  learnings  and  benchmarks 
(EALRs) 

Aligning  curriculum  and  instruction  with 
EALRs 

86 

96 

80 

88 

Classroom-based  assessments  (e.g.,  Stiggins 
training,  assessment  Took  Kits) 

80 

76 

Not  only  do  principals  understand  the  reform,  but  they  endorse  its  key  goals  for  students. 
As  Table  8  shows,  about  three-quarters  of  principals  believe  the  goals  of  the  reform  are 
attainable,  and  an  even  greater  percentage  believe  the  standards  set  by  the  EALRs  are 
appropriate. 


Table  8 

Principals’  Opinions  About  Reform  Goals 

(percent  of  principals  who  somewhat  agree  or  strongly  agree) 


Statement 

Elementary 

school 

Middle 

school 

The  EARLs  are  appropriate  for  the  benchmark 
grade  levels  (grades  4,  7  and  10) 

87 

88 

The  goals  of  Washington’s  education  reform  are 
attainable  (e.g.,  all  students  will  be  able  to 
think  analytically,  logically  and  creatively) 

79 

72 

Principals  report  participating  in  a  large  amount  of  professional  development  during  the 
1997-98  and  1998-99  school  years,  much  of  it  focusing  on  the  reform.  The  median  elementary 


20 


principal  spent  80  hours  in  professional  development  during  the  past  two  years,  with  65  hours  of 
that  time  related  to  Washington’s  education  reform.  Similarly,  the  median  middle  school 
principal  spent  80  hours  in  professional  development  during  the  past  two  years,  and  50  hours  was 
related  to  reform.  In  terms  of  emphasis,  more  than  80%  of  principals  reported  that  their 
professional  development  placed  either  a  moderate  amount  or  a  great  deal  of  emphasis  on  the 
EALRs,  WASL,  and  curriculum  alignment.  Slightly  fewer  (72%)  said  their  professional 
development  emphasized  classroom-based  assessment. 

Few  of  the  principals  we  surveyed  served  on  any  state  committees  responsible  for 
planning  or  implementing  the  reform,  but  many  served  on  reform-related  district  committees  and 
one-half  or  more  served  on  committees  at  their  school.  Table  9  shows  that  most  principals  were 
directly  involved  in  aligning  curriculum  and  instruction  with  EALRs  at  the  district  and  school 
levels.  A  slightly  higher  percentage  of  middle  school  principals  than  elementary  school 
principals  participated  in  district-level  planning  committees  of  each  type. 

Table  9 

Principal  Service  on  Committees  Related  to  Education  Reform 

(percent  of  principals) 


Committee 

Elementarv  school 
District  School 

Middle  school 
District  School 

Alignment  of  curriculum  and  instruction 

43 

63 

50 

76 

with  EALRs 

Developing  EALRs  or  related  materials 

33 

51 

40 

60 

Preparing  classroom  based  assessment 

18 

57 

26 

56 

materials 

Developing  WASL  or  related  materials 

12 

53 

32 

60 

Developing  accountability  system 

14 

53 

32 

50 

Alignment  of  Standards,  Assessments  and  Curriculum 

Many  districts  had  content  standards  in  the  core  subject  areas  prior  to  the  adoption  of  the 
EALRs,  and  almost  all  districts  took  actions  to  adopt  or  revise  standards  after  the  EALRs  were 
developed1.  More  than  two-thirds  of  the  elementary  school  principals  indicated  that  their 
districts  had  standards  in  reading,  writing  and  mathematics  prior  to  the  adoption  of  the  EALRs 
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(see  Table  10).  The  percentages  were  lower  for  the  other  subjects,  but  in  every  subject  at  least 
one-third  of  the  elementary  principals  confirmed  the  existence  of  district  standards  prior  to  the 
EALRs.  The  percentages  were  lower  for  middle  school  principals,  but  the  pattern  was  similar. 

After  the  EALRs  were  adopted,  almost  all  districts  took  actions  to  bring  local  standards  in 
line  with  state  standards,  either  by  developing  new  standards  or  revising  existing  ones.  As  Table 
10  shows,  87%  or  more  of  principals  indicated  that  their  district  took  actions  to  revise  or  develop 
standards  in  the  four  subjects  currently  tested  by  WASL.  Fewer,  but  still  many,  principals 
reported  having  district  standards  in  subjects  not  tested  by  WASL. 


Table  10 

Existence  of  District  Standards 


Subjects 

Had  district  standards 
prior  to  EALRs 
Elementary  Middle 

Revised  or  developed  standards 
since  EALRs 

Elementary  Middle 

Reading 

76 

47 

87 

94 

Writing 

66 

53 

89 

96 

Mathematics 

79 

44 

90 

90 

Communication 

36 

29 

88 

87 

Social  studies 

53 

40 

84 

82 

Science 

61 

40 

79 

87 

Arts 

43 

24 

77 

66 

Health  and  fitness 

45 

28 

63 

71 

As  a  result  of  these  actions,  most  principals  believe  that  their  district’s  standards  are 
aligned  with  the  EALRs  and  with  the  WASL  tests.  As  the  first  column  in  Table  1 1  shows,  in 
reading,  writing  and  mathematics  more  than  90%  of  principals  reported  their  districts  standards 
to  be  somewhat  well  aligned  or  very  well  aligned  with  the  EALRs.  Over  80%  of  principals 
thought  their  district  s  assessments  were  aligned  with  WASL  in  these  three  subjects,  as  well. 
The  values  were  slightly  lower  for  communication/listening.  In  subjects  not  tested  by  WASL, 

between  one-half  and  three-quarters  of  principals  felt  their  district’s  standards  were  aligned  with 
the  EALRs. 


1  The  surveys  were  sent  to  a  representative  sample  of  elementary  and  middle  school  principals,  and  the 
numbers  in  the  table  generalize  to  all  principals  in  the  state  (within  the  margin  of  sampling  error).  They  do  not 
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Table  11 

Alignment  of  State  and  District  Standards  and  Assessments 

(percent  of  principals  indicating  district  standards  and  assessments 
are  somewhat  well  or  very  well  aligned  with  state  reforms) 


Subjects 

District  standards  District  assessments 
aliened  with  EALRs  aliened  with  WASL 
Elem.  Middle  Elem.  Middle 

Reading 

94 

96 

83 

88 

Writing 

94 

98 

91 

91 

Mathematics 

93 

90 

82 

86 

Communication/listening 

83 

83 

76 

77 

Social  studies 

65 

61 

- 

_ 

Science 

67 

76 

_ 

_ 

Arts 

56 

61 

_ 

Health  and  fitness 

56 

56 

- 

Almost  all  principals  also  reported  that  their  schools’  curriculum  was  well  aligned  with 
the  EALRs  in  the  WASL-tested  subjects.  Table  12  shows  that  over  90%  of  principals  reported 
strong  alignment  between  curriculum  and  the  EALRs  in  the  tested  subjects.  The  percentage 
drops  to  50%-60%  in  the  non-tested  subjects.  Middle  school  principals  were  more  likely  to  think 
their  district  standards  and  curriculum  were  “very  well  aligned”  to  EALRs. 

Table  12 

School  Curriculum  Aligned  with  EALRs 

(percent  of  principals  reporting  somewhat  or  very  well  aligned) 


Elementary  school  Middle  school 

Benchmark  Other  Benchmark  Other 
Subject _ grades _ grades _ grades _ grades 


Reading 

100 

98 

96 

93 

Writing 

98 

98 

100 

100 

Mathematics 

94 

91 

90 

91 

Communication/listening 

77 

74 

85 

86 

Social  studies 

64 

65 

64 

66 

Science 

68 

72 

79 

77 

Arts 

51 

53 

60 

60 

Health  and  fitness 

57 

56 

65 

65 

As  in  the  case  of  standards,  school  districts  also  appear  to  have  changed  their  assessments 
in  response  to  Washington’s  education  reform.  Many  have  added  or  revised  assessments:  70% 
of  principals  reported  that  their  districts  have  implemented  new  district  assessments  since  the 


necessarily  generalize  to  all  districts  in  the  state. 
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Washington  education  reform,  and  68%  changed  the  content  of  their  assessments  to  align  them 
with  EALRs.  As  shown  in  Table  1 1  (above),  75%  or  more  of  the  principals  believe  that  these 
district  tests  are  aligned  with  WASL  in  the  WASL-tested  subjects. 

Eighty-one  percent  of  principals  reported  district  testing  in  at  least  one  state-tested 
subject.  Most  of  the  additional  district  testing  is  in  the  subjects  of  reading,  writing  and 
mathematics  (in  that  order).  One-quarter  of  principals  also  reported  that  their  district  requires 
student  testing  in  at  least  one  subject  not  currently  tested  by  the  state  (e.g.,  social  studies, 
science,  arts,  or  health  fitness). 

Overall,  the  testing  burden  on  schools  appears  to  be  increasing.  The  number  of  WASL 
tests  being  administered  is  scheduled  to  increase,  and  districts  are  continuing  or  expanding  their 
own  testing  programs.  About  two-thirds  of  principals  (64%)  said  that  their  district  increased  or 
began  implementing  new  district  assessments  since  the  state  reform.  Only  16%  of  principals 
reported  that  their  districts  phased  out  assessments  or  plan  to  phase  out  assessments,  given  the 
implementation  of  the  WASL  tests. 

There  are  some  differences  in  the  frequency  of  district  testing  reported  by  elementary  and 
middle  school  principals.  Overall,  a  slightly  higher  percentage  of  elementary  school  principals 
(85%)  than  middle  school  principals  (76%)  reported  supplemental  district  testing  in  at  least  one 
subject.  The  difference  was  large  only  in  the  subject  of  reading,  where  87%  of  elementary 
principals  reported  additional  district  testing  compared  to  57%  of  middle  school  principals.  Most 
districts  that  administered  their  own  tests  did  so  in  more  than  one  grade  level,  and  fewer  than 
one-quarter  of  principals  reported  that  their  district  tested  students  in  the  first  grade. 

Districts  administer  a  variety  of  different  types  of  assessments,  including  commercially- 
developed  and  locally-developed  tests  in  both  multiple  choice  and  performance  formats. 
Commercial,  standardized  tests  are  the  most  common:  two-thirds  of  the  principals  whose 
districts  administered  tests  (67%)  used  this  type  of  examination  (e.g.,  Levels,  Stanford-9). 

2  In  elementary  and  middle  schools  during  the  1998-99  school  year,  WASL  tests  in  reading,  writing, 
mathematics,  and  communication  are  administered  in  grades  four  and  seven,  and  ITBS  tests  in  reading  and 
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However,  more  than  one-half  of  the  principals  whose  districts  administered  tests  gave  locally- 
developed  tests,  and  the  majority  of  these  were  performance  assessments.3 

Influence  of  Reform  Elements 

The  vast  majority  of  principals  reported  that  the  Washington  education  reform  promoted 
better  instruction  and  increased  student  learning.  As  Table  13  shows,  some  elements  of  the 
reform  were  more  influential  than  others.  A  greater  percentage  of  the  principals  reported  that  the 
EALRs  and  the  WASL  exerted  a  positive  influence  than  did  classroom-based  assessments  or 
district  assessments.  WASL  short  answer  questions  and  WASL  extended  response  items  had  a 
greater  impact  than  did  WASL  multiple  choice  items.  Elementary  school  principals  were  more 
likely  than  middle  school  principals  to  respond  that  these  education  reforms  had  “a  great  deal”  of 
influence  on  instruction  and  student  learning. 

Table  13 

Degree  to  Which  Reform  Elements  Promoted 
Better  Instruction  and  Increased  Student  Learning 

(percent  of4eaehers  reporting  a  moderate  amount  or  a  great  deal) 


Aspect  of  reform 

Elementary 

school 

Middle 

school 

EALRs 

83 

84 

WASL  short  answer  items 

85 

84 

WASL  extended  response  items 

96 

82 

WASL  multiple  choice  items 

60 

63 

Classroom-based  assessments  (e.g.,  Stiggins 
training,  assessment  Tool  Kits) 

79 

61 

District  assessments 

63 

63 

Almost  all  principals  agreed  that  teachers  need  to  change  their  teaching  practices  to 
support  the  education  reform  (see  Table  14).  They  also  believed  the  reform  was  encouraging 
changes  that  were  already  in  progress. 


mathematics  are  administered  in  grades  three  and  eight.  Beginning  in  1999-2000,  the  ITBS  will  be  given  in  grades 
three,  six,  and  nine. 

3  Of  those  who  reported  district  or  school  developed  assessments,  48%  reported  district-designed 
performance  tasks,  26%  reported  district-designed  multiple  choice  tests,  31%  reported  school-designed  performance 
tests,  and  1 1%  reported  school  designed  multiple  choice  tests.  Some  reported  more  than  one  type  of  locally 
developed  test. 


25 


Table  14 

Principals’  Opinions  About  Education  Reform 

(percent  of  principals  who  somewhat  agree  or  strongly  agree) 


Statement 

Elementary 

school 

Middle 

school 

Washington’s  education  reform  encourages  our 
school  to  make  the  changes  we  were  already  in 
the  process  of  making 

90 

76 

Teachers  need  to  change  their  teaching  practices 
to  support  Washington’s  education  reform 

98 

94 

Principals  reported  they  felt  widespread  pressure  for  students  to  perform  well  on  all 
outcome  indicators,  but  they  felt  the  greatest  pressure  for  students  to  perform  well  on  the  state 
assessments  (WASL  and  the  ITBS).  (see  Table  15).  WASL  scores  are  the  greatest  source  of 
concern;  overall  95%  of  principals  felt  a  moderate  amount  or  a  great  deal  of  pressure  for  their 
students  to  perform  well  on  WASL.  Since  WASL  was  mandatory  in  fourth  grade  in  1997-98  but 
not  in  seventh  grade  it  is  understandable  that  a  higher  percentage  of  elementary  principals  than 
middle  school  principals  felt  “a  great  deal”  of  pressure  for  their  students  to  perform  well  on 
WASL.  However,  elementary  principals  also  reported  greater  pressure  for  students  to  do  well  on 
the  state  norm-referenced  test  (ITBS).  The  perceived  pressure  to  perform  well  on  district  tests 
and  classroom-based  assessments  is  less  intense  than  the  pressure  to  perform  well  on  the  state 
assessments,  in  part  because  some  districts  do  not  administer  district  tests. 


Table  15 

Perceived  Pressure  for  Students  to  Perform  Well  on  Selected  Indicators 

(percent  of  principals) 


Indicator  of  performance 

A  moderate  amount 
Elem.  Middle 

A  ereat  deal 
Elem.  Middle 

WASL 

14 

40 

82 

54 

ITBS  testing  required  by  the  state 

27 

55 

69 

34 

District  performance  tasks 

32 

49 

32 

2 

District  multiple  choice  assessments 

43 

44 

17 

4 

Classroom-based  assessments 

35 

50 

21 

8 

The  pressure  to  perform  well  comes  from  many  quarters,  but  district  administrators,  the 
media  and  OSPI  were  the  most  prominent  sources  reported  by  principals.  Table  16  shows  that 
almost  all  principals  felt  a  moderate  or  a  great  deal  of  pressure  from  their  district  administrators. 
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and  over  80%  felt  strong  pressure  from  the  media  and  from  OSPI.  About  two-thirds  of 
principals  also  felt  pressured  by  local  stakeholders:  parents  and  students,  school  staff  and  the 
business  community.  More  elementary  principals  felt  a  great  deal  of  pressure  than  middle  school 
principals,  particularly  from  the  business  community  and  the  media. 


Table  16 

Source  of  Pressure  to  Improve  WASL  Performance 

(percent  of  principals  reporting  a  moderate  amount  or  a  great  deal  of  pressure) 


Source  of  pressure 

Elementary 

school 

Middle 

school 

District  administrators 

94 

96 

Media 

88 

90 

OSPI 

84 

92 

Your  school  staff 

67 

66 

Business  community 

65 

60 

Parents  and  students  at  your  school 

63 

70 

Actions  in  Response  to  Reform 

Schools  initiated  a  number  of  actions  in  response  to  the  Washington  education  reform, 
including  refocusing  their  professional  development  activities  and  taking  a  range  of  specific 
steps  to  improve  student  performance  on  WASL.  Almost  all  principals  believe  that  education 
reform  has  led  to  valuable  professional  development  opportunities  for  teachers  (94%  of 
elementary  principals,  90%  of  middle  school  principals).  One  specific  instance  of  this  is  the 
Learning  Improvement  Allocations  schools  received  in  1998-99  to  support  reform-related 
professional  development.4  The  typical  elementary  school  received  about  $12,500  and  the 
typical  middle  school  received  about  $14,000  in  LIA  funds.  In  addition,  about  70%  of 
elementary  schools  and  45%  of  middle  schools  used  funds  from  other  sources  (e.g.,  Title  I,  Goals 
2000)  for  professional  development.  In  general,  the  schools  that  also  used  other  sources  of  funds 
for  professional  development,  were  able  to  increase  their  professional  development  funding  by 
about  50%  with  these  monies. 


4  Learning  Improvement  Allocations,  formerly  known  as  Student  Learning  Improvement  Grants  (SLIGs). . . 
$50.4  M  in  1999.  The  1999  State  legislature  replaced  LIAs  with  funds  for  Learning  Improvement  Days,  up  to  three 
staff  development  days  for  each  school. 
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Most  school-initiated  professional  development  focused  on  curriculum  alignment,  the 
EALRs,  and  WASL.  Three-quarters  or  more  of  the  principals  indicated  that  their  professional 
development  activities  focused  on  these  three  components  of  the  reform  (see  Table  17).  Only 
one-half  indicated  that  professional  development  focused  on  district  testing.  It  is  interesting  to 
note  that,  with  only  small  exceptions,  the  emphasis  of  professional  development  was  similar  for 
middle  schools  as  for  elementary  schools  and  for  teachers  in  benchmark  grades  as  for  teachers  in 
other  grades.  A  lower  percentage  of  schools  focused  professional  development  on  alignment  in 
mathematics  than  in  reading  and  writing.  Perhaps  mathematics  was  the  focus  last  year  because 
the  fewest  students  met  the  standards  in  mathematics  among  the  subjects  tested  by  the  WASL.  A 
substantially  lower  percentage  of  middle  schools  than  elementary  schools  emphasized 
classroom-based  assessments  or  district  assessments. 


Table  17 

Focus  of  School  Professional  Development 

(percent  of  principals  saying  a  moderate  amount  or  a  great  deal) 


Focus 

Elementary  school 
Bench¬ 
mark  Other 

grades  grades 

Middle  school 
Bench¬ 
mark  Other 

grades  grades 

Essential  learnings  and  benchmarks 
(EALRs) 

78 

75 

77 

61 

Washington  student  assessment  (WASL) 

78 

67 

71 

53 

Classroom-based  assessments  (e.g., 

Stiggins  training,  assessment  Tool  Kits) 

73 

71 

52 

50 

Aligning  curriculum  and  instruction  with 
EALRs  in  mathematics 

67 

60 

65 

62 

Aligning  curriculum  and  instruction  with 
EALRs  in  writing 

90 

81 

80 

67 

Aligning  curriculum  and  instruction  with 
EALRs  in  reading 

94 

92 

75 

74 

District  assessments 

52 

52 

36 

33 

Schools  have  taken  a  number  of  other  actions  to  improve  WASL  scores,  including 
providing  professional  development,  sharing  information  about  WASL,  trying  to  motivate 
teachers  and  students,  changing  school  schedules  and  other  related  policies,  and  improving 
curriculum  and  instruction.  Table  18  shows  the  range  of  activities  undertaking  by  schools  in 
response  to  WASL.  Many  of  these  actions  are  designed  to  help  students  master  the  knowledge 
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and  skills  embodied  in  the  EALRs.  Others  are  more  narrowly  focused  on  WASL-tested  skills. 
Some  may  improve  WASL  scores  without  changing  students  underlying  knowledge  and  skills. 
Information  about  the  actions  schools  are  taking  to  improve  scores  can  help  us  assess  the  validity 
of  WASL  scores  (i.e.,  the  extent  to  they  represent  real  improvement  in  student  master  of 
standards). 


Table  18 

Activities  Undertaken  in  Response  to  WASL 

(percent  of  principals) 


Activity 

Elementary 

school 

Middle 

school 

Convey  information  about  WASL 

Held  staff  meetings  that  focus  on  WASL  issues 

100 

98 

Held  cross-grade  meetings  to  discuss  WASL  test  results 

88 

78 

Had  teachers  or  school  leadership  team  take  WASL  test 

82 

70 

items 

Promote  professional  development 

Encouraged  teachers  to  obtain  assessment  Tool  Kit 

96 

88 

training 

Directed  Student  Learning  Improvement  Grant 

88 

96 

(SLIG/LIA)  funds  towards  WASL-related  activities 
Motivate  students  and  provide  test  preparation 

Implemented  test  preparation  activities  (e.g.,  Example 

100 

92 

Tests) 

Appealed  to  teachers’  and  students’  school  pride  to  do 

88 

96 

well  on  WASL 

Provided  release  time  for  teachers  to  prepare  for  WASL 

67 

82 

Provided  incentives  for  students  related  to  WASL 

29 

35 

performance  (e.g.,  parties,  fieldtrips) 

Change  school  schedules  and  other  policies 

Implemented  schedule  changes  that  increased  time  for 

71 

55 

math,  reading,  and/or  writing 

Extended  instructional  hours  (e.g.,  created  all-day 

49 

42 

kindergarten,  instituted  Summer  school,  created 
Saturday  school) 

Changed  report  card  format 

47 

4 

Instituted  a  student  grade-level  retention  or  promotion 

27 

46 

policy 

Transferred  teachers  to  different  grades  or  subjects 

16 

18 

Change  curriculum  and  instruction 

Developed  a  school  plan  for  improving  performance  on 

100 

72 

WASL 

Instituted  school  wide  policies  to  address  curriculum 

73 

65 

gaps  (e.g.,  use  of  Weekly  Reader,  "task  of  the  week") 
Created  homework  clubs 

39 

48 

29 


The  most  widespread  school  responses  to  WASL  were  to  convey  information  about  the 
tests  and  to  promote  professional  development  (see  Table  18).  Over  80%  of  schools  organized 
meetings  of  groups  of  teachers  and  staff  to  share  information  about  WASL  in  one  form  or 
another.  Almost  all  schools  also  offered  professional  development  opportunities  that  focus  on 
WASL-related  issues.  Almost  all  schools  also  engaged  in  activities  to  motivate  students  and 
prepare  them  for  taking  standardized  tests.  Over  one-quarter  provided  explicit  incentives  for 
students  to  do  well,  including  such  things  as  parties  and  fieldtrips.  About  one-half  of  the  schools 
changed  schedules  in  one  way  or  another  to  increase  or  focus  time  on  tested  subjects.  Many 
schools  also  instituted  school-wide  policies  to  address  curriculum  gaps. 

District  assessments  have  a  much  lower  profile  than  WASL  tests  for  most  schools.  As 
Table  19  shows,  50%-70%  of  principals  said  that  district  test  results  are  publicly  reported  (vs. 
universal  public  reporting  of  WASL  and  ITBS  scores).  District  tests  are  used  more  for 
instructional  purposes,  such  as  referring  students  to  special  programs  or  grouping  students  for 
instruction  than  for  accountability  purposes.  About  one-third  of  principals  reported  that  district 
tests  are  used  as  the  basis  for  student  promotion  or  retention.  In  a  handful  of  schools,  district 
tests  results  are  used  to  evaluate  teachers. 


Table  19 

Use  of  District  Assessments 

(percent  of  principals  whose  districts  administer  additional  tests) 


Use  of  assessment 

Elementary 

school 

Middle 

school 

Referring  students  to  special  programs  (e.g., 
summer  school  after  school  programs) 

76 

78 

Grouping  students  for  instruction 

68 

69 

Public  reporting 

51 

70 

Student  grade  level  retention  or  promotion 

37 

32 

School-level  consequences  (e.g.,  assistance  for 
low  performing  schools) 

27 

32 

Teacher  evaluation 

17 

14 

Over  90%  of  principals  believe  that  teachers  need  to  change  their  practices  to  improve 
student  performance,  and  that  better  classroom-based  assessments  will  lead  to  improved  WASL 
scores  in  the  future.  However,  about  three-quarters  of  principals  believe  that  better  test 
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preparation  was  responsible  for  most  WASL  score  gains  in  the  past  (see  Table  20).  While  most 
principals  credit  test  preparation  with  helping  to  raise  scores,  only  about  40%  think  it  is  easy  to 
raise  WASL  scores  by  focusing  on  a  few  specific  skills.  Overall,  principals  hold  mixed  opinions 
about  the  factors  that  affect  WASL  scores.  Two-thirds  of  principals  believe  that  the  WASL  tests 
are  of  appropriate  difficulty,  and  a  similar  number  believe  differences  from  one  cohort  of 
students  to  the  next  make  it  difficult  to  prepare  students  properly.  Less  than  one-half  think  that 
sufficient  accommodations  are  provided  for  students  with  special  needs. 

Table  20 

Principals’  Opinions  About  WASL  Scores  and  Assessments 

(percent  of  principals  who  somewhat  agree  or  strongly  agree) 


Statement 

Elementary 

school 

Middle 

school 

Teachers  need  to  change  their  teaching  practices 
to  support  the  Washington  education  reform 

98 

94 

Better  classroom-based  assessments  will  lead  to 
improved  WASL  scores 

92 

94 

Better  test  preparation  is  responsible  for  most 
WASL  score  gains 

69 

82 

The  WASL  tests  are  of  appropriate  difficulty  for 
the  tested  grade  levels 

67 

60 

Differences  in  student  characteristics  from  year  to 
year  make  it  difficult  to  prepare  students  for 
WASL 

67. 

59 

The  WASL  tests  permit  sufficient 

accommodations  for  students  with  disabilities 
and  Limited  English  Proficient  students 

42 

41 

There  has  been  little  focus  on  classroom  based 
assessments  because  scores  from  these 
assessments  are  not  reported 

35 

49 

It  is  easy  to  raise  student  WASL  scores  by 
focusing  on  a  few  specific  skills 

39 

40 

It  is  interesting  to  see  how  responsibility  is  divided  for  various  elements  of  the  education 
reform.  According  to  principals,  district  administrators  or  district  committees  are  almost  always 
responsible  for  textbook  selection,  and  in  more  than  one-half  of  the  cases  they  are  also 
responsible  for  aligning  curriculum  with  the  EALRs  (see  Tables  21  and  22).  School  principals 
and  district  administrator  share  the  responsibility  for  providing  information  to  teachers  about  the 
EALRs  and  WASL.  Decisions  regarding  professional  development  and  allocating  professional 
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development  resources  are  most  often  made  by  school  leadership  teams  or  by  school  principals. 
Classroom  teachers  most  often  retain  the  responsibility  for  developing  classroom-based 
assessments.  These  patterns  were  similar  in  elementary  and  middle  schools. 


Table  21 

Primary  Responsibility  for  Decision-Making:  Elementary  Schools 

(percent  of  principals) 


Activity 

Selecting  textbooks 
Selecting  other  instructional  materials 
Developing  classroom-based  assessments 
Planning  professional  development 
activities 

Determining  how  professional 
development  funds  are  spent 
Providing  information  to  teachers  about 
the  EALRs  and  WASL 
Aligning  curriculum  with  the  EALRs  at 
benchmark  grades 

Aligning  curriculum  with  the  EALRs  at 
other  grades 

Analyzing  WASL  results  _ 


District 
admini¬ 
strators, 
teams  or 
committees 

School 

admini¬ 

strators 

School 

shared 

decision 

making 

teams 

Teachers 

88 

10 

2 

25 

2 

43 

30 

15 

2  . 

17 

66 

36 

11 

50 

2 

10 

2 

83 

4 

43 

43 

13 

51 

4 

18 

27 

56 

7 

13 

24 

30 

28 

33 

9 

Table  22 

Primary  Responsibility  for  Decision-Making:  Middle  Schools 

(percent  of  principals) 


Activity 

Selecting  textbooks 

Selecting  other  instructional  materials 

Developing  classroom-based  assessments 

Planning  professional  development  activities 

Determining  how  professional  development 
funds  are  spent 

Providing  information  to  teachers  about  the 
EALRs  and  WASL 

Aligning  curriculum  with  the  EALRs  at 
benchmark  grades 

Aligning  curriculum  with  the  EALRs  at 
other  grades 

Analyzing  WASL  results _ 


District 

School 

admini¬ 

shared 

strators, 

School 

decision 

teams  or 

admini¬ 

making 

committees 

strators 

teams 

Teachers 

71 

24 

4 

36 

20 

44 

29 

22 

49 

25 

25 

50 

18 

9 

73 

37 

47 

14 

2 

58 

5 

21 

16 

62 

5 

21 

12 

32 

34 

27 

7 

32 


RESULTS:  ELEMENTARY  AND  MIDDLE  SCHOOL  TEACHERS 

Approximately  two-thirds  of  the  teachers  understand  the  EALRs,  WASL  and  how  to 
align  curriculum  with  the  EALRs,  but  less  than  one-half  report  that  they  understand  classroom 
based  assessments.  Furthermore,  about  two-thirds  of  teachers  believe  the  broad  goals  of  the 
reform  are  attainable  and  the  standards  are  appropriate. 

Most  teachers  report  that  their  curriculum  is  aligned  with  the  EALRs  in  the  subjects  that 
are  tested  by  the  state,  but  the  degree  of  alignment  is  lower  in  subjects  that  are  not  tested.  Three- 
quarters  of  the  teachers  who  use  textbooks  to  teach  writing  and  mathematics  indicate  that  these 
materials  are  aligned  with  the  EALRs,  as  well. 

Most  teachers  think  the  education  reform  has  promoted  better  instruction  and  increased 
student  learning,  but  some  components  of  the  reform  are  more  influential  than  other  components. 
Two-thirds  of  the  teachers  said  the  EALRs  and  the  WASL  short  answer  and  extended  response 
items  had  a  positive  impact,  while  one-half  or  fewer  said  classroom  based  assessments,  district 
assessments  or  the  WASL  multiple  choice  items  were  influential.  Locally  administered 
professional  development  was  one  of  the  most  important  influences  on  the  teaching  of  writing 
and  mathematics.  On  average,  teachers  participated  in  about  three  days  of  professional 
development  each  year,  and  about  one-half  of  this  was  related  directly  to  the  Washington 
education  reform.  In  addition,  many  teachers  served  on  school  or  district  committees  responsible 
for  implementing  parts  of  the  reform.  However,  this  professional  development  focused  on 
subjects  that  are  tested  as  part  of  WASL  far  more  than  other  subjects  addressed  in  the  EALRs. 

As  a  result  of  these  influences,  teachers  made  changes  to  curriculum  and  instruction. 
Elementary  school  teachers  increased  the  time  they  spend  on  WASL-tested  subjects  and 
decreased  the  time  they  spend  on  aspects  of  the  standards  that  are  not  tested.  Writing  teachers  in 
the  fourth  and  seventh  grades  emphasize  writing  conventions  and  the  writing  process,  which  are 
traditional  aspects  of  writing.  However,  most  teachers  are  also  increasing  their  emphasis  on 
using  a  style  appropriate  to  the  audience  and  purpose  and  on  writing  for  different  purposes, 
which  are  less  traditional  elements  of  writing  promoted  by  the  EALRs.  Both  fourth  grade 
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teachers  and  seventh  grade  teachers  ask  students  to  write  on  a  daily  or  weekly  basis,  but  most 
often  students  work  on  short  pieces  of  one  to  two  paragraphs.  Over  the  last  two  years,  some 
teachers  have  increased  the  amount  of  writing  assignments  they  give,  most  frequently  the  shorter 
pieces.  More  fourth  grade  teachers  than  seventh  grade  teachers  increased  the  number  of  writing 
assignments.  Teachers  also  made  some  changes  in  the  methods  they  used  to  teach  writing, 
incorporating  more  rubric-based  approaches  to  writing. 

Three-quarters  of  the  mathematics  teachers  emphasized  number  sense  on  a  weekly  or 
daily  basis,  which  was  much  more  than  any  other  content  area.  However,  in  response  to  the 
reform,  almost  one-half  of  the  teachers  increased  the  emphasis  they  gave  to  probability  and 
statistics.  Most  teachers  emphasized  most  of  the  mathematical  processes  that  are  delineated  in 
the  EALRs,  and  they  increased  their  emphasis  on  analyzing  information,  investigating  situations, 
representing  and  sharing  information,  and  drawing  conclusions  and  verifying  results. 

Elementary  school  teachers  reported  greater  changes  in  mathematics  curriculum  than  middle 
school  teachers.  While  mathematics  teaching  methods  did  not  change  much,  the  majority  of 
teachers  also  said  they  increased  the  frequency  of  open-response  questions  with  many  right 
answers.  Students  were  asked  to  write  about  mathematics  more  frequently,  and  also  to  explain 
their  thinking  to  other  students  and  represent  things  in  graphs. 

Teachers  have  mixed  opinions  about  the  WASL  and  WASL  scores.  Many  think  the  test 
is  not  of  appropriate  difficulty.  Many  also  think  test  score  changes  are  due  primarily  to  test 
preparation  activities  and  changes  in  the  students  from  year  to  year.  Nevertheless,  teachers  have 
taken  many  steps  to  improve  WASL  scores.  These  include  activities  designed  to  promote 
mastery  of  elements  of  the  EALRs  as  well  as  activities  that  focus  more  narrowly  on  the  format 
and  content  of  the  test. 

Teachers’  Understanding  of  Education  Reform 

The  majority  of  teachers  report  that  they  understand  the  EALRs,  WASL  and  curriculum 
alignment  either  well  or  very  well,  but  less  than  one-half  report  similar  levels  of  understanding 
about  classroom-based  assessments.  As  Table  23  shows,  80%  or  more  of  the  teachers  think  they 
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understand  the  WASL  well,  while  60%  or  more  indicate  they  understand  the  EALRs  and 
curriculum  alignment.  Despite  the  fact  that  the  EALRs  were  developed  and  circulated  first, 
WASL  appears  to  have  garnered  more  of  teachers’  attention.  Fourth  grade  teachers  are 
somewhat  more  familiar  with  the  reform  than  seventh  grade  teachers,  as  might  be  expected  since 
elementary  teachers  have  had  one  more  year  of  exposure  to  the  WASL. 


Table  23 

Teachers’  Understanding  of  Education  Reform 

(percent  of  teacher  who  understand  well  or  very  well) 


Aspect  of  reform 

Fourth 

grade 

teachers 

Seventh 

grade 

writing 

teachers 

Seventh 

grade 

mathematics 

teachers 

Washington  student  assessment  (WASL) 

94 

80 

84 

Essential  learnings  and  benchmarks  (EALRs) 

86 

76 

68 

Aligning  curriculum  and  instruction  with 
EALRs 

78 

68 

63 

Classroom-based  assessments  (e.g.,  Stiggins 
training,  assessment  Tool  Kits) 

55 

43 

41 

Fewer  teachers  report  that  they  understand  classroom-based  assessment  well.  The 
percentage  of  teachers  who  understand  CBA  is  20  to  25  points  lower  than  the  percentage  who 
understand  the  other  aspects  of  the  reform.  This  pattern  is  consistent  with  the  relative  emphasis 
that  classroom-based  assessment  receives  in  teachers’  professional  development  (see  below). 


Teachers  endorse  the  broad  goals  of  the  reform  and  way  they  are  operationalized  in  the 
standards.  As  Table  24  shows,  more  than  one-half  of  the  teachers  believe  the  goals  of  the  reform 
are  attainable  and  believe  the  standards  set  by  the  EALRs  are  appropriate  for  the  benchmark 
grade  levels.  However,  a  sizable  minority  of  teachers — more  than  one-third — disagree  that  the 
goals  are  attainable  and  that  the  standards  are  appropriate.  Fourth  grade  teachers  who  have  had 
the  most  exposure  to  the  WASL  tests  are  the  most  cautious.  Only  60%  think  the  EALRs  are 
appropriate  for  fourth  grade,  and  only  one-half  think  the  goals  are  attainable.  Seventh  grade 
mathematics  teachers  are  also  very  concerned  with  the  goals  of  reform;  fewer  than  one-half 
believe  the  goals  are  attainable. 
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Table  24 

Teachers’  Opinions  About  Reform  Goals 

(percent  of  teachers  who  somewhat  agree  or  strongly  agree) 


Statement 

Fourth 

grade 

teachers 

Seventh 

grade 

writing 

teachers 

Seventh 

grade 

mathematics 

teachers 

I  he  EALRs  are  appropriate  for  the  benchmark 
grade  levels  (grades  4, 7  and  10) 

61 

67 

64 

The  goals  of  Washington’s  education  reform  are 
attainable  (e.g.,  all  students  will  be  able  to 
think  analytically,  logically  and  creatively) 

51 

66 

44 

Teachers  had  access  to  many  sources  of  information  about  the  education  reform,  but  most 
teachers  learned  about  the  reform,  at  least  in  part,  through  formal  professional  development. 
Teachers  participated  in  a  substantial  amount  of  professional  development  in  the  last  two  school 
years  (1997-98  and  1998-99).  The  median  number  of  hours  of  professional  development  during 
these  two  years  was  50  hours,  approximately  three  full  days  each  school  year.  Approximately 
one-half  of  this  training  was  related  directly  to  the  Washington  education  reform  (50%  for  fourth 
grade  teachers  and  seventh  grade  math  teachers,  44%  for  seventh  grade  writing  teachers). 

In  addition,  many  teachers  served  on  district  or  school  committees  responsible  for 
planning  or  implementing  educational  reform. 5  Table  25  shows  that  about  one-half  or  more  of 
the  teachers  were  involved  in  school-level  committees  and  about  one-quarter  or  more  were 
involved  in  district  level  committees.  The  greatest  percentage  of  teachers  served  on  committees 
devoted  to  classroom-based  assessments.  Many  teachers  also  served  on  local  committees 
working  on  aligning  curriculum  and  instruction  with  the  EALRs  and  developing  WASL-related 
materials.  A  much  smaller  percentage  teachers  were  involved  with  committees  working  directly 
on  accountability.  This  is  to  be  expected  since  the  accountability  provisions  of  the  state  reform 
are  still  under  development. 


5  Only  a  handful  of  teachers  in  our  sample  served  on  committees  at  the  state  level. 
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The  percentage  of  fourth  grade  teachers  who  served  on  committees  at  either  level  was 
higher  than  the  percentage  of  seventh  grade  mathematics  teachers  or  seventh  grade  writing 
teachers.  This  is  may  be  related  to  the  earlier  administration  of  the  WASL  in  fourth  grade. 

Table  25 

Teacher  Service  on  Committees  Related  to  Education  Reform 

(percent  of  teachers  reporting  participation) 


Fourth  Seventh  grade  Seventh  grade 

grade  writing  mathematics 

teachers  teachers  teachers 


Committee 

District 

School 

District 

School 

District 

School 

Preparing  materials  related  to 
classroom  based  assessment 

16 

69 

16 

56 

22 

53 

Aligning  curriculum  and 
instruction  with  EALRs 

37 

52 

26 

51 

31 

60 

Developing  EALRs  or  related 
materials 

28 

37 

24 

33 

27 

46 

Developing  WASL  or  related 
materials 

8 

39 

5 

30 

14 

30 

Developing  accountability 
system 

7 

34 

8 

28 

8 

27 

Alignment  of  Standards  and  Curriculum 

Most  teachers  reported  that  their  curriculum  and  their  instructional  materials  were 
somewhat  well  or  very  well  aligned  with  the  EALRs.  Table  26  shows  teachers’  responses  to 
questions  about  alignment  in  all  the  subjects  for  which  there  are  EALRs.  Almost  all  fourth  grade 
teachers  and  seventh  grade  writing  teachers  indicated  that  their  writing  curriculum  was  aligned 
with  the  EALRs.  A  slightly  lower  percentage  of  teachers  found  their  mathematics  curriculum  to 
be  well  aligned  with  the  EALRs. 

Teachers  also  reported  that  their  curriculum  materials  were  well  aligned  with  the  EALRs. 
In  writing,  slightly  more  than  one-half  of  the  fourth  grade  teachers  (55%)  and  about  three- 
quarters  (74%)  of  the  seventh  grade  writing  teachers  indicated  that  they  used  a  writing  or 
language  arts  textbook.  Approximately,  three-quarters  of  these  teachers  indicated  that  their 
writing  textbook  was  aligned  with  the  EALRs.  A  similar  degree  of  alignment  was  reported  for 
mathematics  materials.  Almost  all  fourth  grade  teachers  (93%)  and  the  seventh  grade 
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mathematics  teachers  (89%)  used  a  mathematics  textbook.  Of  these,  71%  indicated  that  their 
textbook  was  somewhat  well  aligned  or  very  well  aligned  with  the  EALRs  in  mathematics. 


Table  26 

Alignment  of  Curriculum  with  EALRs 

(percent  of  those  who  teach  subject  reporting  somewhat  well  or  very  well  aligned) 


Content  areas 

Fourth 

grade 

teachers 

Seventh  grade 
writing 
teachers 

Seventh  grade 
mathematics 
teachers 

Reading 

82 

95 

Writing 

89 

93 

Mathematics 

81 

82 

Communication/listening 

62 

91 

Social  studies 

53 

76 

Science 

52 

Arts 

39 

Health  and  fitness 

XT_a_ .  A  i  •  _ 

37 

~ 

— 

Note:  Alignment  ratings  were  omitted  when  fewer  than  30%  of  the  teachers  reported 
that  they  taught  this  subject. 


Almost  all  teachers  believe  they  understand  the  content  they  need  to  know  to  prepare 
students  to  succeed  on  WASL.  Eighty  percent  of  fourth  grade  teachers,  87%  of  seventh  grade 
writing  teachers  and  88%  of  seventh  grade  mathematics  teachers  agreed  or  strongly  agreed  that 
they  had  adequate  knowledge  of  content  to  meet  the  demands  of  WASL. 

Influence  of  Reform  Elements 

Most  teachers  feel  that  reforms  promote  better  instruction  and  increased  student  learning. 
However,  teachers  found  some  aspects  of  the  reform  more  influential  than  others  (see  Table  27). 
For  example,  about  two-thirds  of  teachers  said  the  EALRs  and  the  WASL  short  answer  and 
extended  response  items  contributed  to  better  instruction  and  increased  student  learning.  Fewer 
teachers  believed  that  the  WASL  multiple  choice  items,  classroom-based  assessments  or  district 
assessments  promoted  improved  teaching  and  learning.  In  particular,  less  than  one-third  of  the 
seventh  grade  mathematics  teachers  thought  that  WASL  multiple  choice  items  or  classroom- 
based  assessments  promoted  better  instruction. 
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Table  27 

Degree  to  Which  Reform  Elements  Promoted 
Better  Instruction  and  Increased  Student  Learning 

(percent  of  teachers  reporting  a  moderate  amount  or  a  great  deal) 


Aspect  of  reform 

Fourth 

grade 

teachers 

Seventh 

grade 

writing 

teachers 

Seventh 

grade 

mathematics 

teachers 

EALRs 

68 

68 

50 

WASL  short  answer  items 

68 

67 

61 

WASL  extended  response  items 

67 

72 

70 

WASL  multiple  choice  items 

50 

44 

32 

Classroom-based  assessments  (e.g., 

53 

43 

29 

Stiggins  training,  assessment  Tool  Kits) 
District  assessments 

41 

55 

28 

Two-thirds  of  the  teachers  said  they  needed  to  change  their  teaching  practices  to  support 
the  education  reform  (see  Table  28).  They  also  said  the  reforms  reinforced  the  changes  they 
were  already  in  the  process  of  making. 


Table  28 

Opinions  About  Education  Reform 

(percent  of  teachers  who  somewhat  agree  or  strongly  agree) 


Statement 

Fourth 

grade 

teachers 

Seventh 

grade 

writing 

teachers 

Seventh 

grade 

mathematics 

teachers 

Washington’s  education  reform  encourages 

68 

79 

61 

me  to  make  the  changes  that  I  was  already 

in  the  process  of  making 

I  need  to  change  my  teaching  practices  to 

67 

61 

63 

support  Washington’s  education  reform 


Teachers  responded  differently  to  various  elements  of  the  Washington  education  reform. 
Table  29  illustrates  the  relative  impact  of  aspects  of  the  Washington  education  reform  on  the 
content  and  teaching  of  writing.  The  state-administered  WASL  test  and  the  WASL  scores 
appear  to  be  the  most  influential  factors.  About  three-quarters  of  writing  teachers  in  both  grade 
levels  reported  that  WASL  had  a  moderate  or  a  great  deal  of  influence  on  changes  in  their 
writing  instruction.  A  similar  proportion  said  that  their  schools’  WASL  scores  contributed  to 
making  changes  in  their  writing  program.  In  fact,  all  the  state-administered  aspects  of  the 
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Washington  education  reform  (including  WASL,  EALRs,  and  classroom-based  assessments)  had 
a  moderate  amount  of  influence  for  more  than  one-half  of  the  teachers. 

Locally  administered  professional  development  was  one  of  the  most  important  influences 
on  teachers’  responses  to  the  Washington  education  reforms.  Two-thirds  of  writing  teachers  in 
both  grade  levels  said  professional  development  had  a  moderate  or  great  deal  of  influence  on 
their  writing  instruction.  However,  district-level  reforms  were  somewhat  less  influential.  About 
one-half  of  the  teachers  said  their  district  standards  and  their  locally  administered  district 
assessments  influenced  their  writing  teaching.  This  result  is  consistent  with  the  lower  frequency 
of  district  writing  tests.  Only  about  40%  teachers  (35%  of  fourth  grade  teachers  and  44%  of 

seventh  grade  writing  teachers)  reported  that  their  district  administered  its  own  assessment  of 
writing  at  their  grade  level. 


Table  29 

Influences  on  Writing  Lessons  and  Instruction 

(percent  of  teachers  indicating  a  moderate  amount  or  a  great  deal) 


Aspect  of  Washington  education  reform 

Grade  4 

Grade  7 

WASL 

75 

76 

In-service  training  or  formal  professional  development 
on  methods  of  teaching  writing 

66 

66 

Scores  on  WASL  tests 

64 

73 

Classroom-based  assessments 

65 

60 

EALRs 

64 

66 

District  standards 

53 

56 

District  assessments 

45 

53 

Most  mathematics  teachers  indicated  that  WASL  extended  response  items  had  the 
greatest  impact  on  their  teaching,  followed  by  the  WASL  short  answer  items  and  WASL  scores 
(see  Table  30).  Multiple  choice  items  on  the  WASL  were  the  least  influential  of  the  state  and 
district  reforms.  Fewer  than  one-half  of  teachers  found  WASL  multiple  choice  items  to  have 
moderate  or  great  influence.  Seventy-one  percent  of  the  fourth  grade  teachers  regarded  the 
EALRs  as  at  least  moderately  influential,  but  barely  one-half  of  the  seventh  grade  teachers 
regarded  EALRs  as  influential. 
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As  with  writing,  locally  administered  professional  development  in  mathematics  had  a 
moderate  or  a  great  deal  of  influence  for  nearly  two-thirds  of  the  teachers.  Fewer  teachers  found 
district-level  reforms  to  be  influential.  Although  more  than  half  of  teachers  reported  that  district 
standards  influenced  their  mathematics  curriculum  and  instruction,  only  about  40%  indicated  that 
district  assessments  at  least  moderately  influential.  Only  42%  of  fourth  grade  teachers  and  46% 
of  seventh  grade  teachers  reported  that  their  district  administered  its  own  tests  in  mathematics. 

Table  30 

Influences  on  Mathematics  Lessons  and  Instruction 

(percent  of  teachers  indicating  a  moderate  amount  or  a  great  deal) 


Aspect  of  Washington  education  reform 

Grade  4 

Grade  7 

WASL  extended  response  items 

86 

85 

WASL  short  answer  items 

76 

76 

Scores  on  WASL  tests 

75 

71 

EALRs 

71 

52 

Classroom-based  assessments 

69 

58 

In-service  training  or  formal  professional  development 
on  methods  of  teaching  writing 

62 

64 

District  standards 

60 

61 

WASL  multiple  choice  items 

45 

41 

District  assessments 

45 

38 

Actions  in  Response  to  Education  Reform 

Teachers  responded  to  the  reform  in  a  variety  of  ways,  including  participating  in  focused 
professional  development.  Overall,  about  one-half  of  the  teachers  agreed  that  the  education 
reform  led  to  valuable  professional  development  opportunities.  Seventh  grade  writing  teachers 
were  most  positive  in  this  regard.  Sixty-four  percent  of  seventh  grade  writing  teachers  credited 
the  reform  with  creating  new  professional  development  opportunities  compared  to  46%  of  fourth 
grade  teachers  and  50%  of  seventh  grade  mathematics  teachers. 

In  terms  of  content  areas,  most  of  the  professional  development  that  teachers  participated 
in  focused  on  the  subjects  tested  on  WASL  or  on  the  state  norm-referenced  test,  i.e., 
mathematics,  writing  and  reading  (see  Table  31).  Fewer  than  one-quarter  of  the  teachers 
participated  in  professional  development  that  emphasized  social  studies,  science,  arts,  or  health 
and  fitness.  Listening  is  the  only  tested  subject  that  was  not  a  major  focus  of  teachers’ 
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professional  development.  Conversations  with  Washington  educators  suggest  this  may  have 
been  due  to  the  brevity  of  the  WASL  listening  test  and  to  early  indications  that  students  were 
mastering  the  listening  requirements. 


Table  31 

Emphasis  of  Professional  Development  on  Content  Areas 

(percent  of  teachers  reporting  a  moderate  amount  or  a  great  deal  of  emphasis) 


Content  areas 

Fourth 

grade 

teachers 

Seventh  grade 
writing 
teachers 

Seventh  grade 
mathematics 
teachers 

Reading 

79 

60 

40 

Writing 

81 

73 

48 

Mathematics 

68 

9 

72 

Communication/listening 

12 

31 

20 

Social  studies 

5 

13 

5 

Science 

16 

4 

15 

Arts 

7 

2 

0 

Health  and  fitness 

1 

0 

2 

In  general,  teachers  were  satisfied  with  the  quality  of  the  content  area  professional 
development.  In  fact,  a  sizable  percentage  of  teachers — about  one-third — rated  the  training  they 
received  in  WASL-tested  subjects  as  excellent  (See  Table  32).  The  majority  of  teachers 
(between  51%  and  73%)  rated  the  quality  of  the  training  in  every  subject  as  average. 

Table  32 

Quality  of  Professional  Development  in  Content  Areas 

(percent  of  teachers  reporting  excellent) 


Content  areas 

Fourth 

grade 

teachers 

Seventh  grade 
writing 
teachers 

Seventh  grade 
mathematics 
teachers 

Reading 

23 

46 

23 

Writing 

33 

39 

18 

Mathematics 

33 

31 

Communication/listening 

— 

15 

7 

Social  studies 

_ 

__ 

Science 

__ 

Arts 

__ 

Health  and  fitness 

_ 

_ 

Note:  Quality  ratings  for  a  subject  were  omitted  when  fewer  than  20%  of  the  teachers 
participated  in  professional  development  that  emphasized  that  subject 


Teachers  also  reported  on  their  participation  in  professional  development  that  focused  on 
the  elements  of  the  educational  reform-assessments  and  curriculum  alignment  (see  Table  33). 
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Approximately  one-half  of  the  teachers  reported  that  their  professional  development  activities 
focused  either  a  moderate  amount  or  a  great  deal  on  WASL  in  the  subject(s)  they  teach.  Almost 
as  many  reported  a  moderate  or  strong  professional  development  focus  on  aligning  curriculum 
and  instruction  with  the  EALRS.  A  much  lower  percentage  of  the  teachers  (between  one-quarter 
and  one-third)  participated  in  professional  development  that  emphasized  district  assessments  or 
classroom-based  assessments. 


Table  33 

Emphasis  of  Professional  Development  on  Reform  Components 

(percent  of  teachers  reporting  a  moderate  or  a  great  deal  of  emphasis) 


Fourth  Seventh  grade  Seventh  grade 

grade  writing  mathematics 


Topic _ teachers _ teachers _ teachers 


WASL  in  reading 

47 

56 

32 

WASL  in  writing 

53 

66 

50 

WASL  in  mathematics 

46 

12 

60 

WASL  in  listening 

11 

27 

12 

Classroom-based  assessments 

31 

32 

20 

District  assessments 

27 

37 

32 

Aligning  curriculum  and 
instruction  with  EARLs 

42 

47 

61 

The  majority  of  teachers  rated  professional  development  related  to  assessments  and 
curriculum  alignment  as  average  (50%  to  80%).  Table  34  shows  the  percentage  of  teachers  who 
rated  each  type  of  professional  development  as  excellent.  Seventh  grade  writing  teachers  were 
much  more  satisfied  with  professional  development  related  to  the  WASL  in  reading  and  writing 
than  any  other  teachers  or  any  other  subjects.  A  sizable  minority  of  seventh  grade  mathematics 
teachers  (38%)  rated  professional  development  regarding  classroom-based  assessment  as  poor. 

Changes  in  Instructional  Time.  The  allocation  of  instructional  time  to  subjects  appears 
to  be  influenced  by  the  state  testing  program  more  than  the  state  standards.  Fourth  grade 
teachers,  who  teach  all  subjects,  reported  increasing  the  instructional  time  devoted  to  subjects 
tested  on  WASL  and  the  ITBS  at  the  expense  of  non-tested  subjects.  Table  35  shows  that 
teachers  spend  a  majority  of  their  instructional  time — 63%-on  the  core  subject  areas  of  reading, 
mathematics  and  writing.  Teachers  spend  substantially  less  time  on  social  studies,  science. 
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listening,  arts,  and  health  and  fitness.  Moreover,  teachers  had  increased  the  time  they  spent  on 
tested  subjects  during  the  past  two  years,  while  decreasing  the  time  they  spent  on  the  non-tested 
subjects.  About  one-quarter  of  the  teacher  have  incresed  the  time  they  spend  on 

communications/listening,  but  the  total  amount  of  instructional  time  devoted  to  this  subject  is 
still  relatively  low. 


Table  34 

Quality  of  Professional  Development  on  Assessment  and  Alignment 

(percent  of  teachers  reporting  excellent) 


Topic 

Fourth 

grade 

teachers 

Seventh  grade 
writing 
teachers 

Seventh  grade 
mathematics 
teachers 

WASL  in  reading 

13 

43 

15 

WASL  in  writing 

18 

45 

15 

WASL  in  mathematics 

13 

27 

WASL  in  listening 

9 

Classroom-based  assessments 

12 

25 

17 

District  assessments 

9 

8 

13 

Aligning  curriculum  and 
instruction  with  EARLs 

12 

18 

11 

Note:  Quality  ratings  were  omitted  when  fewer  than  20%  of  the  teachers  participated  in 
professional  development  that  emphasized  that  subject 


Table  35 

Instructional  Emphases  Across  Subjects 

(median  hours  and  percent  of  teachers  indicating  change) 


Content  areas 

Hours  per  week 

Percent 
of  total 
Median  hours 

Chanee  in  hours 
Number  of  Number  of 
teachers  teachers 

indicating  indicating 
decrease  increase 

Total 

25 

_ 

5 

21 

Reading 

6 

25% 

2 

53 

Writing 

4 

17% 

2 

70 

Mathematics 

5 

21% 

1 

59 

Communication/listening 

2 

8% 

13 

24 

Social  studies 

3 

13% 

50 

3 

Science 

2 

8% 

55 

8 

Arts 

1 

4% 

52 

4 

Health  and  fitness 

1 

4% 

46 

1 

Other 

0 

0% 

Impact  on  Writing  Content,  Teaching  Strategies,  and  Activities.  Writing  teachers  in 
the  fourth  and  seventh  grades  reported  that  they  have  changed  the  content  of  their  writing  lessons 
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and  their  teaching  methods  over  the  last  two  years.  At  fourth  grade,  42%  of  teachers  changed 
their  writing  pedagogy  and  content  a  great  deal,  and  81%  of  teachers  reported  making  at  least  a 
moderate  amount  of  change.  Fewer  seventh  grade  writing  teachers  made  changes:  29%  reported 
a  great  deal  of  change  and  55%  reported  at  least  a  moderate  amount  of  change. 

The  content  of  writing  teaching  is  broadly  reflective  of  the  EALRs  in  both  the  fourth  and 
seventh  grades.  Eleven  of  the  fourteen  writing  behaviors  specified  in  the  EALRS  are  covered 
weekly  or  more  often  by  over  40%  of  the  teachers  in  both  grade  levels  (see  Table  36).  However, 
teachers  concentrate  classroom  time  more  on  writing  conventions  and  on  the  writing  process 
than  on  the  other  elements  of  the  EALRs.  Over  80%  of  teachers  in  both  grades  addressed  the 
application  of  writing  conventions  at  least  weekly.  All  the  elements  of  the  writing  process 
except  publishing  (i.e.,  pre-write,  draft,  revise,  edit  publish)  were  covered  at  least  weekly  by 
more  than  two-thirds  of  the  fourth  grade  teachers  and  more  than  one-half  of  the  seventh  grade 
writing  teachers.  Teachers  in  both  grade  levels  focused  less  often  on  writing  for  different 
purposes,  different  audiences,  writing  in  different  forms,  and  writing  for  career  applications, 
which  are  the  less-traditional  aspects  of  the  writing  EALRs. 

Table  36 

Frequency  of  Coverage  and  Change  in  Frequency  of  Coverage 
of  Selected  Aspects  of  Writing 

(percent  of  teachers) 


Aspects  of  writing  (from  EALRs) 

Cover  aspect 
weeklv  or  dailv 
Grade  4  Grade  7 

Increased  coverage 
durins  past  two  vears 
Grade  4  Grade  7 

1 .3  Application  of  writing  conventions 

86 

83 

37 

46 

3.2  Draft 

73 

65 

34 

35 

3.4  Edit 

68 

57 

36 

32 

3.1  Pre-write 

67 

67 

35 

38 

3.3  Revise 

66 

56 

44 

35 

4.2  Seek  and  offer  feedback 

54 

50 

38 

51 

4. 1  Assessment  of  students’  strengths  and 
needs  for  improvement 

46 

43 

44 

43 

1.1  Development  of  concept  and  design 

44 

45 

48 

49 

1 .2  Style  appropriate  to  audience  and  purpose 

42 

32 

51 

60 

2.2  Write  for  different  purposes 

42 

44 

51 

49 

3.5  Publish 

42 

41 

31 

23 

2.3  Write  in  a  variety  of  forms 

38 

43 

46 

45 

2.1  Write  for  different  audiences 

28 

22 

43 

53 

2.4  Write  for  career  applications 

3 

4 

19 

20 

45 


Teachers  also  reported  that  they  were  changing  their  emphasis  on  writing  topics,  and  the 
greatest  increases  in  coverage  were  for  the  less-traditional  topics.  Roughly  one-half  of  the 
teaches  in  both  grade  levels  reported  increasing  their  coverage  of  different  audiences,  purposes, 
and  forms  of  writing,  as  well  as  the  application  of  styles  appropriate  to  different  audiences  and 
purposes.  Fewest  teachers  increased  coverage  of  the  most  frequently  covered  EALRs, 
suggesting  that  teachers’  emphasis  on  writing  conventions  and  the  writing  process  precede  much 
of  the  reform. 

Teachers  were  also  changing  the  methods  they  used  to  teach  writing.  Teachers  reported 
the  frequency  with  which  they  used  15  different  instructional  strategies,  ranging  from  fairly 
traditional  techniques,  e.g.,  ‘read  orally  to  students,”  to  more  innovative  approaches,  e.g.,  “write 
with  students  on  the  same  assignment”  (see  Table  37).  Most  teachers  in  both  grades  read  to 
students  at  least  once  a  week  and  taught  language  mechanics  (grammar,  spelling,  punctuation 
and  syntax)  as  frequently.  More  than  one-half  of  the  teachers  taught  about  word  choice  and 
helped  students  revise  their  work  on  a  weekly  or  daily  basis.  Far  fewer  teachers  in  either  grade 
regularly  looked  at  writing  from  other  content  areas,  held  conferences  with  students  about  their 
writing,  or  wrote  along  with  students  on  the  same  assignment. 

Four  of  the  five  most  frequently  used  teaching  strategies— read  orally  to  students,  explain 
writing  mechanics,  suggest  revisions  to  student  writing  and  give  examples  of  appropriate  word 
choice-are  shared  by  teachers  in  both  grades.  However,  more  fourth  grade  teachers  were  likely 
to  read  orally  to  students  on  a  daily  or  weekly  basis:  97%  of  fourth  grade  teachers  vs.  76%  of 
seventh  grade  teachers.  Fourth  grade  teachers  were  also  more  likely  to  use  rubric-based 
approaches  to  writing  frequently;  over  60%  of  fourth  grade  teachers  taught  “six  trait”  or  other 
rubric-based  approaches  to  writing  at  least  weekly  compared  to  about  40%  of  seventh  grade 
writing  teachers.  Regular  time  for  unstructured  “free”  writing  and  for  pre-writing  activities  was 
also  somewhat  more  common  among  fourth  than  seventh  grade  teachers. 
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Table  37 

Frequency  of  Use  and  Change  in  Frequency  of  Use 
of  Selected  Teaching  Strategies  in  Writing 

(percent  of  teachers) 


Use  strategy  Increased  use  during 

weekly  or  daily  past  two  years 


Teaching  strategy _ Grade  4  Grade  7  Grade  4  Grade  7 


Read  orally  to  students 

97 

76 

13 

30 

Explain  correct  usage  of  grammar,  spelling, 

90 

86 

20 

46 

punctuation  and  syntax 

Suggest  revisions  to  student  writing 

62 

61 

32 

37 

Teach  Six-Trait  or  other  rubric-based 

64 

41 

56 

61 

approach  to  writing 

Give  examples  of  choosing  appropriate  words 

62 

65 

31 

39 

to  describe  objects  or  experiences 

Use  examples  to  discuss  the  craft  of  an 

58 

63 

28 

43 

author’s  writing 

Provide  time  for  unstructured  (“free”)  writing 

53 

40 

14 

25 

Demonstrate  the  use  of  prewriting 

51 

37 

40 

46 

Provide  a  prompt  to  initiate  student  writing 
Assess  students’  writing  skills 

44 

45 

30 

39 

45 

50 

29 

35 

Provide  time  for  students  to  conference  with 

38 

29 

31 

44 

each  other  about  writing 

Show  examples  of  writing  in  different  content 

30 

25 

35 

35 

areas 

Comment  on  student  writing  in  different 

30 

31 

62 

69 

content  areas 

Conference  with  students  about  their  writing 

31 

15 

27 

25 

Write  with  students  on  the  same  assignment 

19 

7 

25 

24 

The  greatest  changes  in  writing  instruction  were  in  the  use  of  rubric-based  approaches 
and  in  commenting  on  student  writing  in  different  content  areas.  The  majority  of  teachers  in 
both  grade  levels  increased  their  use  of  these  two  strategies  for  teaching  writing.  One-quarter  to 
one-third  of  the  teachers  reported  increasing  their  use  of  other  many  other  strategies.  For  most  of 
the  teaching  techniques  in  the  survey  the  degree  of  change  was  similar  among  fourth  grade 
teachers  and  seventh  grade  writing  teachers.  The  two  exceptions  were  explaining  mechanics  and 
reading  orally  to  students.  More  seventh  teachers  than  fourth  grade  teachers  increased  the 
frequency  of  explaining  writing  mechanics  (46%  vs  40%)  and  reading  orally  to  students  (30% 
vs.  13%).  Overall,  more  teachers  reported  changing  how  writing  was  taught  than  what  was 
taught. 

Writing  teachers  gave  students  regular  writing  assignments,  but  most  of  the  writing 
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assignments  were  short  pieces,  one  to  two  paragraphs  in  length.  Eighty-five  percent  of  fourth 
grade  teachers  and  91%  of  seventh  grade  writing  teachers  reported  that  their  students  produced 
these  short  written  works  on  a  weekly  or  daily  basis.  Sixty-three  percent  of  teachers  indicated 
that  students  produced  mid-length  pieces  (one  to  two  pages  length)  only  once  or  twice  a  month. 
Over  one-half  of  the  teachers  indicated  that  students  wrote  long  pieces  (three  or  more  paragraphs 
in  length)  only  once  or  twice  a  semester.  The  length  of  the  written  work  increased  as  student 
grew  older.  Fourth  grade  students  were  asked  to  write  shorter  pieces  (one  to  two  paragraphs) 
slightly  more  frequently  than  seventh  grade  students,  and  seventh  grade  students  were  asked  to 
write  longer  pieces  (three  or  more  pages)  more  often  than  fourth  grade  students. 

The  amount  of  written  work  has  increased  during  the  past  two  years,  but  most  of  the 
increase  was  in  the  form  of  short  pieces.  More  teachers  in  both  grade  levels  increased  the 
frequency  of  short  written  work  than  increased  the  frequency  of  longer  written  work.  For 
example,  45%  of  fourth  grade  teachers  increased  the  frequency  that  students  wrote  short  pieces 
(one  to  two  paragraphs  in  length)  compared  to  35%  who  increased  the  frequency  of  mid-length 
pieces  (one  to  two  pages),  and  only  20%  who  increased  the  frequency  of  long  written  work 
(three  pages  or  longer).  The  increases  were  slightly  more  common  among  fourth  grade  teachers 
than  seventh  grade  writing  teachers.  The  percentage  of  fourth  grade  teachers  who  increased  the 
frequency  of  student  written  work  was  about  five  points  higher  than  the  percentage  of  seventh 
grade  teachers  in  each  category. 

Impact  on  Mathematics  Content,  Teaching  Strategies,  and  Activities.  Washington 
mathematics  teachers  have  changed  the  content  of  their  lessons  and  the  way  they  teach 
mathematics  during  the  past  two  years.  At  fourth  grade,  44%  of  teachers  changed  their  content 
and  pedagogy  a  great  deal  and  84%  of  teachers  reported  at  least  a  moderate  amount  of  change. 
There  was  not  as  much  change  among  seventh  grade  mathematics  teachers;  only  13%  of  teachers 
reported  a  great  deal  of  change  and  about  two-thirds  of  reported  at  least  a  moderate  amount  of 
change. 
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Of  the  five  major  content  areas  of  mathematics,  number  sense  was  covered  at  least 
weekly  by  the  greatest  number  of  teachers  (see  Table  38).  Probability  and  statistics  is  the  topic 
covered  weekly  by  the  fewest  number  of  teachers;  fewer  than  20%  of  teachers  discuss  this  topic 
at  least  weekly.  Furthermore,  content  emphasis  has  not  changed  dramatically  in  the  past  two 
years.  Only  about  one-third  of  the  teachers  reported  increasing  coverage  of  each  of  the  five 
topics  in  the  last  two  years.  The  exception  to  this  pattern  was  probability  and  statistics;  about 
one-half  of  the  mathematics  teachers  increased  their  coverage  during  the  past  two  years. 

Table  38 

Frequency  of  Coverage  and  Change  in  Frequency  of  Coverage 
of  Mathematics  Content  Areas 

(percent  of  teachers) 


Cover  aspect  Increased  coverage 

Mathematics  content  area  weekly  or  daily  during  past  two  years 


(from  EALRs) 

Grade  4 

Grade  7 

Grade  4 

Grade  7 

1.1  Number  sense 

76 

79 

29 

29 

1 .2  Algebraic  sense 

30 

53 

31 

37 

1.3  Measurement 

29 

21 

28 

18 

1 .4  Geometric  sense 

27 

20 

32 

35 

1 .5  Probability  and  statistics 

17 

16 

40 

52 

The  situation  is  somewhat  different  for  mathematical  processes.  Most  teachers  covered  a 
large  number  of  the  mathematical  processes  highlighted  in  the  EALRs  on  a  weekly  or  daily  basis 
(Table  39).  Two-thirds  or  more  of  the  mathematics  teachers  included  analyzing  information, 
constructing  solutions,  relating  concepts  to  real  life,  and  relating  concepts  within  mathematics  in 
their  lessons  on  a  weekly  or  daily  basis.  More  fourth  grade  teachers  than  seventh  grade 
mathematics  teachers  cover  these  mathematical  processes  at  least  weekly.  Teachers  also 
reported  a  substantial  increase  in  the  frequency  with  which  they  address  these  processes  in 
mathematics  lessons,  particularly  among  fourth  grade  teachers.  More  than  one-half  of  the  fourth 
grade  teachers  report  increasing  the  frequency  with  which  they  cover  most  of  the  processes.  In 
seventh  grade,  more  than  one-half  of  the  teachers  increased  the  frequency  of  drawing 
conclusions  and  verifying  results,  investigating  solutions,  organizing  and  interpreting 
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information,  and  representing  and  sharing  information.  These  elements  characterize  a  more 
problem-oriented  approach  to  mathematics. 


Table  39 

Frequency  of  Coverage  and  Change  in  Frequency  of  Coverage 
of  Mathematics  Processes 

(percent  of  teachers) 


Mathematics  process 
(from  EALRs) 

Cover  process 
weeklv  or  dailv 
Grade  4  Grade  7 

Increased  coverage 
during  past  two  vears 
Grade  4  Grade  7 

3.1  Analyze  Information 

79 

61 

70 

46 

5.3  Relate  concepts  to  real-life 

72 

62 

49 

39 

2.3  Construct  solutions 

74 

57 

59 

33 

5.1  Relate  concepts  within  math 

67 

62 

52 

38 

3.3  Draw  conclusions  and  verify 
results 

68 

56 

66 

53 

2. 1  Investigate  situations 

59 

57 

67 

50 

4.2  Organize  and  interpret 
information 

57 

50 

55 

52 

4. 1  Gather  information 

53 

45 

46 

39 

4.3  Represent  and  share  information 

53 

42 

50 

51 

5.2  Relate  concepts  to  other 
disciplines 

49 

32 

43 

40 

2.2  Formulate  questions 

48 

46 

56 

31 

Most  mathematics  teachers  regularly  used  a  wide  range  of  instructional  strategies.  Table 
40  shows  that  most  mathematics  teachers  in  grades  four  and  seven  regularly  use  strategies 
ranging  from  fairly  traditional  techniques,  e.g.,  “conduct  speed  drills,”  to  more  innovative 
approaches,  e.g.,  “ask  open-response  questions  with  many  right  answers.”  Fourth  grade  teachers 
were  much  more  likely  than  seventh  grade  mathematics  teachers  to  demonstrate  mathematical 
ideas  using  constructions  and  manipulatives  and  to  conduct  speed  drills  in  their  classrooms. 

With  the  exception  of  asking  open-response  questions  with  many  right  answers,  most 
mathematics  teachers  did  not  change  how  often  they  used  different  strategies  during  the  last  two 
years.  However,  two-thirds  of  fourth  grade  teachers  and  more  than  one-half  of  seventh  grade 
mathematics  teachers  reported  that  they  asked  more  open-response  questions  with  many  right 
answers.  Such  questions  more  closely  resemble  the  WASL  extended-response  items.  Also, 
nearly  one-half  of  the  mathematics  teachers  increased  the  frequency  of  giving  examples  of  real- 
life  applications  over  the  last  two  years.  It  is  worth  noting  that  more  fourth  and  seventh  grade 
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teachers  decreased  their  use  of  speed  drills  (20%  and  22%  respectively)  during  the  past  two  years 
than  increased  their  use  of  speed  drills. 


Table  40 

Frequency  of  Coverage  and  Change  in  Frequency  of  Coverage 
of  Selected  Teaching  Strategies  in  Mathematics 

(percent  of  teachers) 


Teaching  strategy 

Use  strategy 
weeklv  or  dailv 

Grade  4  Grade  7 

Increased  use  during 
past  two  vears 

Grade  4  Grade  7 

Explain  correct  solutions 

91 

90 

30 

12 

Demonstrate  new  skill 

81 

81 

26 

22 

Ask  open-response  questions  with 
many  right  answers 

83 

72 

65 

58 

Explain  new  concept 

79 

85 

20 

33 

Give  examples  of  real-life 
applications 

76 

73 

47 

44 

Assess  students’  mathematics  skills 

73 

76 

29 

19 

Demonstrate  mathematical  ideas 
using  constructions,  manipulatives, 
etc. 

61 

33 

41 

18 

Conduct  speed  drills 

54 

12 

14 

6 

Almost  all  teachers  had  students  practice  computation  on  a  daily  or  weekly  basis  (see 
Table  41).  However,  most  teacher  also  had  student  regularly  engaged  in  less  traditional 
activities.  For  example,  most  fourth  grade  teachers  also  had  students  work  on  problem  solving  in 
groups  with  other  students,  explain  their  thinking  to  other  students,  and  write  about  mathematics 
at  least  once  a  week.  Most  seventh  grade  teachers  asked  students  to  use  mathematics  to  solve 
real-life  problems;  learn  mathematics  facts,  rules,  and  formulas;  and  write  about  mathematics  at 
least  weekly. 

Mathematics,  as  experienced  by  students,  appears  to  have  changed  over  the  last  two 
years.  Writing  about  mathematics  was  the  activity  whose  frequency  was  increased  by  the 
greatest  number  of  teachers  in  both  grades.  In  addition,  a  majority  of  teachers  also  indicated  that 
there  had  been  an  increase  in  the  amount  of  time  students  spend  explaining  their  thinking  to  other 
students,  and  representing  concepts  or  ideas  in  tables,  graphs,  or  pictures. 

Opinions  and  Actions  Concerning  WASL  Scores.  Mathematics  teachers  hold  mixed 
opinions  about  the  appropriateness  of  WASL  and  about  the  factors  that  affect  WASL  scores. 


51 


Only  about  one-quarter  of  fourth  grade  teachers  and  about  one-third  of  seventh  grade 
mathematics  teachers  believe  that  the  WASL  tests  are  of  the  appropriate  difficulty  for  the  tested 
grade  levels  (see  Table  42).  Furthermore,  most  teachers  agree  that  changes  in  WASL  scores  can 
be  attributed  to  factors  that  are  unrelated  to  the  standards.  Three-quarters  of  the  teachers  believe 
that  better  test  preparation  is  responsible  for  most  of  the  changes  in  WASL  scores.  They  also 
report  that  differences  between  successive  cohorts  of  students  are  an  obstacle  to  preparing 
students  for  WASL.  However,  less  than  one-third  of  fourth  grade  teachers  and  seventh  grade 
mathematics  teachers  believe  that  it  was  easy  to  raise  test  scores  by  focusing  narrowly  on  a  few 
specific  skills  featured  on  the  test. 


Table  41 

Frequency  of  Coverage  and  Change  in  Frequency  of  Coverage 
of  Student  Learning  Activities  in  Mathematics 

(percent  of  teachers) 


Student  learning  activity 

Use  activity 
weeklv  or  dailv 

Grade  4  Grade  7 

Increased  use  during 
past  two  vears 

Grade  4  Grade  7 

Practice  computation 

98 

87 

ii 

25 

Work  in  groups  on  problem  solving 

75 

53 

65 

43 

Explain  thinking  to  other  students 

72 

50 

65 

55 

Write  about  mathematics 

71 

56 

71 

64 

Represent  concepts  or  ideas  in 

63 

50 

53 

54 

tables,  graphs,  or  pictures 

Solve  real-life  problems 

59 

60 

42 

35 

Learn  mathematics  fact,  rules,  or 

58 

57 

7 

1  R 

formulas 

Use  mathematics  in  the  context  of 

44 

30 

23 

17 

other  subjects 

Solve  problems  using  manipulatives 

42 

19 

28 

12 

Use  measuring  tools 

42 

25 

20 

16 

Take  tests  and  quizes 

37 

44 

11 

14 

Discover  concepts  for  themselves 

32 

32 

35 

18 

Extended  mathematics  activities 

31 

19 

43 

28 

Seventh  grade  writing  teachers  present  an  interesting  contrast.  They  are  more  likely  to 
think  that  the  WASL  is  of  the  appropriate  difficulty,  and  they  are  more  likely  to  say  that  scores 
can  be  raised  by  focusing  on  a  few  specific  skills.  These  differences  may  be  explained  by  the 
different  nature  of  the  writing  assessment,  which  consists  of  an  extended  writing  task  rather  than 
a  series  of  short  questions. 
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Teachers  agreed  about  the  potential  of  classroom-based  assessments  (CBA)  to  improve 
scores,  but  indicated  that  CBA  receives  them  less  emphasis  because  the  scores  are  not  part  of  the 
assessment  system.  More  than  two-thirds  of  the  teachers  agreed  that  better  classroom-based 
assessments  would  lead  to  improved  WASL  scores.  However,  more  than  one-half  report  that 
they  focus  on  CBA  less  because  the  scores  are  not  reported.  In  addition,  fewer  than  one-half  of 
teachers  believe  that  the  WASL  tests  permit  sufficient  accommodations  for  special  needs 
students  (students  with  disabilities  and  Limited  English  Proficient  students). 

Table  42 

Opinions  About  WASL  Scores  and  Assessments 

(percent  of  respondents  who  somewhat  agree  or  strongly  agree) 


Seventh  Seventh 
Fourth  grade  grade 

grade  writing  mathematics 

Statement  teachers  teachers  teachers 


Differences  in  student  characteristics  from 
year  to  year  make  it  difficult  to  prepare 
students  for  WASL 

73 

71 

74 

Better  test  preparation  is  responsible  for 
most  WASL  score  gains 

74 

80 

85 

Better  classroom-based  assessments  will 
lead  to  improved  WASL  scores 

69 

83 

80 

There  has  been  little  focus  on  classroom 
based  assessments  because  scores  from 
these  assessments  are  not  reported 

45 

66 

59 

The  WASL  tests  permit  sufficient 
accommodations  for  students  with 
disabilities  and  Limited  English 

Proficient  students 

27 

42 

26 

The  WASL  tests  are  of  appropriate 
difficulty  for  the  tested  grade  levels 

25 

62 

37 

It  is  easy  to  raise  student  WASL  scores  by 
focusing  on  a  few  specific  skills 

21 

47 

30 

Teachers  have  taken  many  steps  to  help  students  perform  well  on  the  WASL  tests. 
Writing  teachers  indicated  more  frequent  use  of  strategies  that  focused  broadly  on  student 
writing  than  strategies  that  focused  narrowly  on  the  tests  (see  Table  43).  In  preparing  students 
for  the  WASL  test  in  writing,  more  than  half  of  teachers  used  two  activities:  six-trait  or  other 
rubric  based  approaches  to  writing  and  open-ended  questions  in  classroom  work.  Most  fourth 
grade  teachers  and  almost  one-half  of  the  seventh  grade  teachers  adopted  a  rubric-based 


53 


approach  to  teaching  writing  at  least  once  a  week.  Three-quarters  of  seventh  grade  teachers  and 
over  one-half  of  fourth  grade  teachers  incorporated  short  answer  questions  into  classroom  work 
once  a  week  or  more  often.  A  number  of  teachers  indicated  that  they  had  increased  their  use  of 
these  two  activities  teaching  six-trait  or  other  rubric  based  approaches  to  writing  and  assigning 
short  written  works  (one  to  two  paragraphs  in  length) — in  the  last  two  years. 

While  WASL-specific  practice  was  not  as  common,  there  was  quite  a  bit  of  it  in 
evidence.  About  two-thirds  of  teachers  in  fourth  grade  engaged  in  narrower  practice  activities  at 
least  once  a  month.  These  activities  included  practice  with  released  items  (60%),  discussion  of 
responses  to  WASL  items  (63%),  practice  using  the  rubrics  to  score  classroom  work  (63%),  and 
displaying  the  scoring  rubrics  in  the  classroom  (64%).  About  20%  fewer  seventh  grade  teachers 
practiced  with  released  items  or  discussed  responses  to  WASL  items  once  a  month  or  more. 

Table  43 

Frequency  of  Activities  to  Help  Students  Do  Well  on  WASL  Test  in  Writing 

(percent  of  teachers) 


Activity  _ 

Teach  Six-Trait  or  other  rubric-based  approach  to  writing 
Use  open-ended  questions  (short  answer  and  extended 
response)  in  classroom  work 
Display  scoring  rubrics  in  classroom 
Discuss  responses  to  WASL  or  WASL-like  items  that 
demonstrate  different  levels  of  performance 
Have  students  practice  using  items  released  from  WASL 
Have  students  score  classroom  work  using  rubrics 
Use  materials  from  assessment  Tool  Kits 


Use  activity  weekly  or  daily 
Grade  4  Grade  7 


64 

48 

59 

77 

39 

42 

29 

30 

29 

14 

27 

22 

24 

9 

Teachers  were  given  an  opportunity  to  describe  other  strategies  they  used  to  prepare 
students  for  WASL  in  writing.  They  reported  a  wide  range  of  activities,  including  some  that 
were  designed  to  foster  writing  broadly  and  others  that  appeared  to  be  narrowly  focused  on  the 
test  itself  and  others.  Narrow  reactions  included: 

“Spent  far  too  much  class  time  teaching  to  the  test  instead  of  teaching.” 

“Pray,  teach  test-taking,  teach  ‘you  must’  revise  and  rewrite.” 

Teachers’  responses  that  appear  to  reflect  the  reform’s  intent  included: 
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“I  have  incorporated  writing  in  all  subject  areas  because  of  WASL.” 

“Given  them  time  to  talk  about  writing  with  each  other  and  with  older  students.” 

Most  teachers’  comments  fell  between  these  extremes.  It  is  difficult  to  say,  in  isolation,  whether 
the  following  comments  represent  appropriate  or  inappropriate  reactions: 

“The  district  prepares  a  task  of  the  month  for  both  reading  and  writing. . .  my  classes 
complete  one  per  month  in  each  area.” 

“I  have  recently  incorporated  WASL-like  assessment  in  nearly  every  unit  I  teach 
throughout  the  year.  These  assessments  include  rubrics  which  imitate  the  WASL  very 
closely.” 

“I’ve  created  user-friendly  WASL  writing  rubrics,  and  as  we  write  for  other  subjects  we 
use  the  rubrics  in  small  groups  to  assess  our  progress.” 

Mathematics  teachers  also  initiated  a  number  of  activities  to  promote  WASL  scores.  Of 
the  types  of  mathematics  test  preparation  that  we  asked  about,  only  one  was  used  frequently  by  a 
majority  of  teachers  (see  Table  44).  One-half  of  fourth  grade  teachers  and  slightly  more  than 
one-half  of  seventh  grade  teachers  reported  frequently  using  open-response  questions  in 
classroom  work  to  help  students  prepare  for  WASL.  The  state-developed  assessment  Tool  Kits 
designed  to  facilitate  better  classroom-based  assessment  were  used  less  frequently,  especially  by 
seventh  grade  teachers,  despite  many  teachers’  belief  that  better  classroom-based  assessment 
would  lead  to  increased  WASL  scores. 


Table  44 

Frequency  of  Activities  to  Help  Students  do  Well  on  WASL  Test  in  Mathematics 

(percent  of  teachers) 


Use  activity  weekly  or  daily 


Activity _ Grade  4 _ Grade  7 

Use  open-ended  questions  (short  answer  and  extended  62  50 

response)  in  classroom  work 

Discuss  responses  to  WASL  or  WASL-like  items  that  48  28 

illustrate  different  levels  of  performance 

Have  students  practice  using  items  released  from  WASL  42  34 

Use  material  from  assessment  Tool  Kits  36  13 

Display  scoring  rubrics  in  classroom  35  15 

Have  students  score  classroom  work  using  rubrics _ 27 _ 16 
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More  direct  test  preparation,  such  as  having  students  practice  WASL  released  items  and 
discussing  responses  to  WASL  or  WASL-like  items,  was  less  common  but  still  occurred  at  least 
weekly  in  48%  of  fourth  grade  classrooms  and  28%  of  seventh  grade  classrooms.  About  25%  of 
teachers  never  use  Tool  Kits  or  rubrics  (displaying  or  using  rubrics)  in  their  mathematics 
instruction. 

In  response  to  an  open-ended  question  asking  teachers  about  test  preparation  activities, 
teachers  indicated  that  they  prepare  students  for  WASL  using  a  range  of  strategies.  Some 
strategies  reflect  the  intent  of  the  reform,  leading  toward  a  “deeper  study  of  important 
mathematics”  (OSPI,  2000).  Some  of  these  strategies  are  narrow,  focusing  on  increasing  test 
scores  without  developing  students’  knowledge  and  skill  of  mathematics.  Other  strategies  fall  in 
the  continuum  between  deeper  understanding  of  mathematics  and  inappropriate  test  practice  that 
artificially  inflates  scores  and.  Narrow  reactions  include: 

Take  aspirin,  attend  workshops,  correlate  EALRs,  try  to  minimize  any  damage  of 
preparing  for  WASL  test  in  lieu  of  teaching  math.  Try  not  to  neglect  other  subjects.” 
Practice  daily  in  warm  ups  at  the  beginning  of  class  as  well  as  once  a  week,  we  have  1 
hour  of  WASL  sample  questions  for  students  to  practice  short  and  extended  response  and 
multiple  choice.” 

“Explaining  answers  and  processes  to  students,  practicing  with  students  to  watch  for  and 
avoid  tricks  and  traps.  Teaching  that  in  the  real  world  in  math,  correct  answers  are 
always  the  principal  objective  only  in  the  state  test  it  is  not.” 

Some  teachers  reported  using  strategies  that  reflect  the  intent  of  the  reforms: 

“Increase  students’  math  vocabulary  in  order  to  discuss  in  words  or  speech  their  solutions 
to  given  problems.” 

“More  group  work,  extended  application  activities  and  more  written  explanations  of  their 
thinking  or  approach.” 
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“Increased  use  of  manipulatives;  am  learning  to  use  new  materials  purchased  by  school 
district  to  teach  mathematics;  less  reliance  on  textbook.  More  emphasis  on  writing  and 
problem  solving.” 

Strategies  that  fall  between  these  extremes  of  appropriateness  include: 

“I  have  truly  stressed  basic  skills.  When  these  are  not  in  place  (and  they  often  are  not),  it 
is  impossible  to  do  well  on  the  higher-level  thinking  skills.” 

“Weekly  story  problems  graded  on  a  rubric.” 

“Keeping  math  journals  with  vocabulary  words  giving  biweekly  quizzes  that  require 
written  responses.  Started  a  problem  solving  class.” 

“I  use  4th  grade  Saxon  math  program  four  days  a  week.  One  day  a  week  is  devoted  to 
problem  solving  using  WASL  sample  questions  and  other  sources  that  require  more  in- 
depth  response.  We  compare  results  and  how  they  would  be  scored  on  the  WASL.” 

The  question  of  appropriate  test  preparation  activities  is  one  that  deserves  continued  study  as  the 
reform  continues  to  be  implemented. 
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DISCUSSION 

This  study  paints  a  picture  of  schools  in  transition,  responding  to  a  state  reform  effort  that 
is  both  incremental  and  evolving.  The  reform  is  incremental  in  the  sense  that  the  statewide 
testing  program  is  being  implemented  gradually  according  to  a  decade-long  timetable.6  It  is 
evolving  in  the  sense  that  elements  are  changing  in  unpredictable  ways.  For  example,  the  nature 
of  state  support  for  professional  development  has  changed  annually  for  the  past  three  years. 
Similarly,  the  accountability  system,  which  will  be  a  cornerstone  of  the  reform,  is  still  being 
designed  by  a  statewide  commission.  Also,  the  grades  tested  by  standardized  norm-referenced 
tests  have  been  fluctuating.  The  survey  results  from  principals  and  teachers  are  consistent  with 
such  a  transitional  reform  setting. 

Status  of  Implementation 

The  Washington  education  reform  resembles  standards-based  reforms  in  other  states  in  a 
number  of  key  respects.  It  was  initiated  at  the  state  level,  it  is  organized  around  a  set  of 
academic  standards  adopted  at  the  state  level,  and  success  will  be  measured  by  scores  on  a 
statewide  test  based  on  the  standards.  Like  other  states,  the  reform  focuses  on  schools  as  the  unit 
of  accountability  rather  than  teachers,  students  or  districts.  (Elmore,  Abelmann,  and  Fuhrman, 
1996).  Local  educators  are  responsible  for  developing  practices  to  help  students  master  the 
standards.  Under  these  circumstances  we  would  expect  a  pattern  of  implementation  that  flows 
“downwards”  from  the  state  to  the  districts,  from  the  district  to  the  schools,  and  then  to 
classrooms.  Responses  to  our  survey  are  quite  consistent  with  this  scenario. 

Although  schools  are  the  formal  unit  of  accountability  in  the  Washington  education 
reform,  districts  play  an  important  role.  Not  only  is  there  a  tradition  of  strong  district  control  in 
the  state,  but  policies  established  at  the  district  level  are  germane  to  the  success  of  the  reform. 
Districts  are  responsible  for  standards,  curriculum,  assessments,  promotion/retention  rules,  report 
cards,  and  other  policies  that  send  messages  to  principals  and  teachers  about  priorities.  When 

6  The  elementary-level  WASL  tests  in  reading,  writing,  listening  and  mathematics  were  available  on  a  voluntary 
basis  for  the  first  time  in  1996-97,  and  the  elementary-level  WASL  tests  in  arts  and  health  and  fitness  will  be 
mandatory  in  2006-07  (see  Table  3). 
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district  and  state  policies  conflict,  teachers  receive  multiple  messages  that  may  reduce  their 
effectiveness  (Smith  and  O’Day,  1991). 

It  appears  that  districts  have  been  quick  to  make  their  policies  consistent  with  the  state 
reform.  In  particular,  most  principals  indicate  that  their  districts  have  either  developed  or  revised 
their  academic  standards  since  the  EALRs  and  WASL  were  introduced.  Also,  most  report  that 
district  standards  are  aligned  with  EALRs  in  the  WASL-tested  subjects  (reading,  mathematics, 
writing,  and  listening).  Somewhat  fewer  principals,  though  still  a  majority,  find  that  their  district 
standards  are  aligned  with  EALRs  in  the  non-tested  subjects  (social  studies,  science,  art,  and 
health  and  fitness).  Districts  have  also  changed  their  assessment  requirements  in  light  of  the 
reform,  and  principals  believe  their  district  tests  are  aligned  with  the  WASL. 

Rapid  changes  have  been  made  at  the  school  level,  as  well.  During  the  past  two  years 
principals  and  teachers  devoted  considerable  effort  to  learning  about  the  reform  and  adapting 
school  practices  to  support  it.  Both  principals  and  teachers  participated  in  professional 
development  activities  during  the  past  two  years,  and  roughly  one-half  of  the  professional 
development  they  received  emphasized  elements  of  the  reform.  In  addition,  many  principals  and 
teachers  served  on  school  leadership  teams  responsible  for  implementing  changes  consistent  with 
the  reform.  Perhaps  as  a  result,  both  principals  and  teachers  believe  they  understand  the 
components  of  the  reform  well.  Moreover,  both  groups  are  generally  supportive  of  the  goals  of 
the  reform.  In  particular,  they  think  the  goals  for  students  (think  analytically,  logically  and 
creatively)  are  attainable  and  the  standards  are  appropriate  for  the  benchmark  grade  levels. 

In  addition  to  raising  awareness,  most  schools  have  taken  steps  to  align  their  local 
curriculum  and  instruction  with  the  EALRs.  Principals  and  teachers  believe  that  the  curriculum 
is  now  well  aligned  in  the  subjects  of  reading,  writing,  and  mathematics,  the  subjects  tested  by 
WASL.  Alignment  is  proceeding  more  slowly  in  the  non-tested  subjects.  Some  schools  have 
gone  further,  and  changed  policies  regarding  scheduling,  grading  and  student  retention.  A 
number  of  schools  have  increased  time  for  reading,  writing,  and/or  mathematics.  Almost  one- 
half  the  elementary  schools  have  changed  their  report  card  format.  Additionally,  almost  one-half 
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of  middle  schools  and  a  smaller  number  of  elementary  schools  have  instituted  student  grade- 
level  retention  or  promotion  policies.  These  are  more  fundamental  changes  to  the  organizational 
and  incentive  structure  in  schools. 

Fourth  grade  teachers  and  seventh  grade  mathematics  and  writing  teachers  are  changing 
curriculum  content  and  instructional  strategies  to  promote  the  goals  of  the  reform.  In  writing, 
teachers  have  increased  their  coverage  of  genres,  style  appropriate  to  audience  and  purpose, 
development  of  concept  and  design  and  variety  of  forms.  Many  writing  teachers  changed  their 
teaching  strategies  as  well,  using  rubric-based  approaches  to  writing,  and  commenting  on  student 
writing  in  different  areas.  In  mathematics,  the  greatest  change  was  in  increase  in  coverage  of 
probability  and  statistics.  They  also  increased  their  attention  to  drawing  conclusions  and 
verifying  results,  investigating  situations,  and  organizing  and  interpreting  information.  Since  the 
reform,  more  mathematics  teachers  are  asking  open-response  questions  with  many  right  answers, 
having  students  explain  their  thinking  to  other  students,  and  having  students  write  about 
mathematics. 

Some  of  these  changes  were  in  response  to  the  EALRs  and  some  appear  to  be  direct 
responses  to  the  format  and  content  of  the  WASL  test.  For  example,  mathematics  teachers’ 
indicated  that  the  WASL  extended  response  and  short  answer  questions  were  very  influential, 
and  attention  to  WASL  may  explain  their  increased  emphasis  on  writing  about  mathematics  and 
asking  open  response  questions  with  many  right  answers.  In  writing,  teachers  increase  in 
attention  to  audience  and  purpose,  expanded  time  for  commenting  on  student  writing,  and  their 
use  of  a  rubric-based  approach  to  teaching  writing  may  also  be  a  result  of  the  testing  program. 
However,  the  aforementioned  changes  are  not  large  in  magnitude.  In  most  cases,  teachers  are 
now  using  these  reform-oriented  strategies  “one  or  two  times  per  month”  when  they  previously 
used  them  much  less  often.  The  bulk  of  their  curriculum  and  instruction  appears  to  be  much  as  it 
was  two  years  ago.  Writing  instruction  still  focuses  primarily  on  conventions  and  the  writing 
process.  Mathematics  instruction  still  emphasizes  number  sense. 
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There  were  some  notable  difference  between  the  responses  of  principals  and  teachers. 
Principals  are  more  optimistic  about  the  status  of  implementation  than  the  teachers.  For 
example,  principals  were  more  positive  about  the  appropriateness  of  the  EALRs  and  the  WASL, 
as  well  as  the  attainability  of  the  overall  goals  of  the  reform.  By  ten  to  twenty  percentage  points, 
more  principals  reported  that  curriculum  in  their  schools  was  aligned  with  the  EALRs  and  that 
each  of  the  components  of  reform  promoted  better  instruction  and  increased  student  learning. 
There  are  a  number  of  possible  explanations  for  these  differences  of  opinion.  They  may  reflect 
the  fact  that  the  reform  is  being  implemented  in  a  top  down  manner  and  principals  are  coming  to 
understand  and  endorse  it  first.  They  may  reflect  the  reluctance  of  teachers  to  change  and  the 
resilience  of  classroom  practices  (Berman  and  McLaughlin,  1978;  Cohen  et.al.,  1990).  Or  they 
may  reflect  teachers’  clearer  understanding  of  the  demands  of  the  reform  at  the  classroom  level. 

Survey  responses  also  show  differences  in  implementation  among  the  components  of  the 
reform.  In  particular,  teachers  are  attending  to  the  WASL  and  EALRs  more  than  the  other 
aspects  of  reform.  Most  educators  understand  the  EALRs  and  WASL  and  most  believe  that 
these  elements  of  reform  promote  better  teaching  and  learning.  On  the  other  hand,  classroom- 
based  assessment,  in  particular,  is  not  as  well  understood  and  is  not  as  widely  implemented.  This 
may  be  due,  in  part,  to  the  fact  that  scores  from  classroom-based  assessment  are  not  used  for 
public  accountability.  Principals  also  reported  that  they  feel  less  pressure  for  their  students  to  do 
well  on  the  classroom-based  assessment  than  on  WASL  or  ITBS. 

Classroom-based  assessment  is  intended  to  play  an  important  role  in  the  reform,  but  it 
appears  to  be  the  most  underdeveloped  component.  Classroom-based  assessment  is  designed  to 
help  teachers  understand  EALRs,  provide  coverage  of  EALRs  not  included  in  the  WASL,  and 
adapt  assessment  to  students'  needs  (Ensign,  1998).  However,  few  teachers  received 
professional  development  in  classroom-based  assessment,  and  few  teachers  understand  it  well. 
The  Commission  on  Student  Learning  developed  Assessment  Tool  Kits  to  support  classroom- 
based  assessment.  Although  principals  encouraged  teachers  to  obtain  Tool  Kit  training,  few 
have  participated,  and  only  a  handful  of  teachers  use  the  Tool  Kit  materials  in  preparing  students 


61 


for  the  WASL.  Attitudes  toward  classroom-based  assessment  are  somewhat  paradoxical. 
Teachers  believe  that  better  classroom-based  assessment  will  lead  to  improved  student  WASL 
performance,  and  many  teachers  participated  on  local  committees  to  develop  classroom-based 
assessments.  However,  this  component  of  the  reform  is  not  widely  implemented. 

Another  interesting  difference  is  that  writing  teachers  seem  to  be  having  an  easier  time 
implementing  the  reform  than  mathematics  teachers.  More  writing  teachers  than  mathematics 
teachers  believe  that  the  reforms  lead  to  better  teaching  and  learning,  that  the  WASL  tests  are  of 
the  appropriate  difficulty,  and  that  the  goals  of  the  reform  are  attainable.  More  writing  teachers 
than  mathematics  teachers  found  their  professional  development  on  WASL  in  their  subject  area 
to  be  excellent.  Middle  school  writing  teachers  also  viewed  their  curriculum  as  more  aligned 
with  the  EALRs  than  did  middle  school  mathematics  teachers.  In  addition,  writing  teachers  were 
more  likely  to  report  that  the  education  reform  supported  the  changes  they  were  already  in  the 
process  of  making.  Writing  teachers  also  used  WASL  practice  items  more  frequently  than 
mathematics  teachers.  Mathematics  teachers,  in  contrast,  are  finding  the  reform  more 
challenging.  One-half  of  the  seventh  grade  mathematics  teachers  agreed  that  aligning  curriculum 
with  EALRs  was  difficult. 

There  were  a  few  differences  associated  with  grade  level,  most  notably  that  fewer  fourth 
grade  teachers  than  seventh  grade  teaches  find  the  WASL  to  be  appropriate  for  students  in  their 
grade  level.  Elementary  principals  and  teachers  were  more  supportive  of  classroom-based 
assessment  than  middle  school  educators.  In  writing,  more  seventh  grade  teachers  than  fourth 
grade  teachers  have  changed  their  writing  curriculum  and  teaching  strategies  in  the  last  two 
years.  In  mathematics,  just  the  opposite  was  true.  More  fourth  grade  teachers  than  seventh 
grade  teachers  made  changes  in  their  curriculum  and  pedagogy  in  the  last  two  years. 

High  Stake  Assessment 

The  high  stakes  associated  with  performance  on  the  WASL  has  led  to  other  changes  in 
practice  that  may  be  cause  for  concern.  Principals  report  that  they  already  feel  a  great  deal  of 
pressure  for  their  students  to  do  well  on  the  WASL,  although  the  formal  accountability  system  is 
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still  under  development.  The  same  pressure  that  leads  to  the  positive  changes  such  as  those 
reported  above,  also  leads  to  potentially  deleterious  behaviors.  Responses  to  the  survey  suggest 
that  teachers  are  focusing  on  the  WASL  test  more  than  the  EALR  standards  are  shifting 
instructional  time  away  from  non-tested  subjects,  and  are  engaged  in  test  preparation  activities 
that  may  reduce  the  validity  of  WASL  scores. 

It  appears  that  changes  in  classroom  practice  are  focused  more  on  the  statewide  test  than 
the  standards  the  test  is  supposed  to  reflect,  i.e.,  more  on  the  WASL  than  the  EALRs.  While  this 
distinction  may  seem  minor  to  some,  it  is  very  important.  Each  WASL  test  samples  only  a 
fraction  of  the  domain  of  performance  described  in  the  EALRs.  Often  times  it  is  the  more 
complex,  conceptual  or  integrated  aspects  of  the  domain  that  are  omitted  from  the  test  because 
they  are  difficult  to  measure  under  controlled  testing  situations.  Furthermore,  each  test  requires 
students  demonstrate  performance  in  a  limited  number  of  ways.  Thus  a  curriculum  that  was 
tailored  to  improve  test  performance  might  ignore  many  critical  aspects  of  the  adopted  standards. 
That  is  why  it  would  be  wrong  for  the  test  to  become  the  de  facto  standards.  However,  this 
substitution  of  test  specifications  and  format  for  standards-based  curriculum  has  been  observed 
in  other  states  with  high-stakes  test-based  accountability  systems.  There  is  evidence  that 
teachers  narrow  their  focus  to  the  tests  and  to  the  test  scoring  criteria  rather  than  the  domains  the 
tests  were  designed  to  assess  (Stecher  and  Mitchell,  1995;  Stecher,  1999).  There  is  some 
evidence  that  this  is  occurring  in  Washington,  and  care  should  be  taken  to  monitor  the  situation. 

Writing  provides  a  specific  example.  Last  year  a  task  force  convened  by  the  state 
recommended  a  change  to  the  WASL  test  in  writing  to  eliminate  uncertainty  about  which  genre 
would  be  tested.  Fourth  grade  was  assigned  narrative  and  expository  writing,  seventh  grade  was 
assigned  persuasive  writing  and  expository  writing,  and  tenth  grade  was  assigned  persuasive  and 
extended  expository  writing.  The  task  force  raised  the  concern  about  teachers’  narrowing  the 
writing  curriculum  to  focus  on  these  genres,  “This  action  is  in  no  way  meant  to  limit  classroom 
instruction  or  district  and  classroom-based  assessments.”  This  survey  occurred  before  the 
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change  took  effect,  but  our  subsequent  survey  and  case  studies  may  be  able  to  address  whether 
writing  curriculum  has  narrowed  since  last  year. 

A  more  immediate  concern  is  a  reallocation  of  instructional  time  away  from  non-tested 
subjects.  Washington  adopted  standards  in  eight  subject  areas,  but  the  survey  shows  that  the 
amount  of  time  spent  on  the  WASL-tested  subjects  has  increased  over  the  last  two  years.  In 
many  cases,  schools  have  changed  their  schedules  to  increase  time  for  reading,  writing  and 
mathematics.  In  other  cases,  fourth  grade  teachers,  who  are  responsible  for  all  subjects  and  have 
some  flexibility  in  allocating  classroom  time,  have  focused  instruction  on  these  subjects.  They 
have  decreased  the  amount  of  time  spent  on  science,  listening,  arts,  and  health  and  fitness.  This 
imbalance  may  be  alleviated  as  the  state  introduces  WASL  tests  in  science,  social  studies,  arts, 
and  health  and  fitness  over  the  next  four  to  seven  years,  but  it  is  a  concern  in  the  interim. 

Schools  that  are  refocusing  on  reading,  mathematics  and  writing  may  produce  better  results  in 
these  areas,  while  doing  a  hidden  disservice  to  students  by  under-emphasizing  the  other  subjects. 

The  emphasis  on  test  scores  had  led  to  an  increase  in  test  preparation  activities  that  may 
reduce  the  meaningfulness  of  the  WASL  results.  For  example,  teachers  are  increasing  their  use 
of  sample  test  items  and  WASL-like  questions  in  class.  By  focusing  narrowly  on  test 
preparation,  rather  than  mastery  of  the  standards,  teachers  may  increase  WASL  scores  without 
increasing  students’  broad  knowledge  of  the  EALRs.  This  is  a  complex  issue,  because  some 
kinds  of  test  familiarization  activities  are  quite  appropriate,  while  other  types  of  focused 
preparation  are  quite  inappropriate.  There  have  been  multiple  instances  recently  of  blatant 
cheating  on  statewide  tests  in  other  states.  The  strongest  evidence  that  concern  is  appropriate  in 
Washington  is  that  both  teachers  and  principals  agree  that  test  preparation  is  responsible  for  most 
WASL  score  gains.  Similar  results  have  been  seen  in  other  states  with  high-stakes  testing 
programs  (Koretz,  et  al.  1996).  The  A+  Commission,  which  is  developing  a  formal 
accountability  mechanism  for  Washington,  would  be  wise  to  study  the  experience  of  other  states 
carefully. 
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A  final  concern  is  the  overall  burden  that  testing  places  on  students  and  teachers.  The 
amount  of  state  testing  has  increased  with  the  implementation  of  WASL  and  the  second  grade 
reading  assessments,  and  it  will  continue  to  increase  over  the  next  seven  years  as  more  WASL 
tests  become  operational.  Since  the  introduction  of  WASL,  rather  than  eliminate  extant  local 
assessments,  many  districts  have  added  or  revised  district  tests.  Thus,  the  overall  time  dedicated 
to  test  administration,  as  well  as  test  preparation,  is  increasing.  Concerns  about  testing  burden 
have  caused  state  legislatures  to  intervene  to  alter  the  testing  plans  in  other  states  (Chun  and 
Goertz,  1998).  Washington  should  be  careful  to  keep  testing  demands  manageable. 
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